Loading...
You are not logged-in Login/Register





  • Posts   Search Threads
  • Clay Breshears (Intel)December 3, 2009 2:10 PM PST   
    Scoring Criteria

    It was decided to create two separate sets of increasingly larger data files and measure the largest data set (based on number of nodes) that could be handled in a fixed amount of time. This is a demonstration of using parallel execution to enhance throughput (doing more work in a set amount of time).

    The first data set collection was graphs based on the N-queens attack patterns for each square on a board. That is, each square on an NxN chessboard was a node and an edge was created from a given square to any other square that could be attacked by a queen sitting on the initial square. Board sizes ranged from 3x3 to 26x26.

    The second data set collection was constructed by using a fixed size binary number as a node and included an edge to another binary number if there was exactly one or two bit differences in the binary number. There were seven possible data files based on 3 to 9 bit node "labels".

    A maximum of five minutes was set for each input data file tested. The largest queen graph file solved in that time limit was 22x22 (484 nodes, 16786 edges). For the binary graphs, the largest file solved correctly was 7 bits (128 nodes, 1792 edges).

    Each data set was worth a maximum of 50 points. The points available were assigned by hand based on the largest data file that could be solved correctly in five minutes or less. If multiple entries reached the same maximum file size within the given time limit, these were ranked by shortest execution time. Entries that did not generate the correct answer on the smallest data set or had compile or runtime issues received zero points for that collection of test data. Several entries were not threaded and were penalized 50 points.

    There were 15 submissions of code solutions, 7 on Linux and 8 on Windows. There was one entry written in Cilk++, two in C#, and the rest in C/C++.

    Point spread:

    94
    83 82
    73
    63
    39 31
    21
    8
    0(6)

    The write-up portion of each entry was read and scored by two judges. Each judge used the 10-30-10 breakdown of points for serial algorithm description, parallel algorithm description, and performance, respectively. One important component to the judging was to determine how close the submission was for publication on ISN. The assigned score was the average of the two judges scores.

    Point spread:

    48 46
    39 35 30 30
    15
    9 9

    Bonus points were given for contestant’s forum posts made before the problem entries were closed. Five points per post (maximum 25 points possible) were awarded.

    The overall winner was BradleyKuszmaul. The two fastest code executions on the biggest problem sizes tested were submitted by avparate and Sean Lee, and the highest scoring write-up was submitted by Waiting4you.

    --clay

    akkiDecember 3, 2009 11:50 PM PST
    Rate
     
    Re: Scoring Criteria

    It was decided to create two separate sets of increasingly larger data files and measure the largest data set (based on number of nodes) that could be handled in a fixed amount of time. This is a demonstration of using parallel execution to enhance throughput (doing more work in a set amount of time).

    The first data set collection was graphs based on the N-queens attack patterns for each square on a board. That is, each square on an NxN chessboard was a node and an edge was created from a given square to any other square that could be attacked by a queen sitting on the initial square. Board sizes ranged from 3x3 to 26x26.

    The second data set collection was constructed by using a fixed size binary number as a node and included an edge to another binary number if there was exactly one or two bit differences in the binary number. There were seven possible data files based on 3 to 9 bit node "labels".

    A maximum of five minutes was set for each input data file tested. The largest queen graph file solved in that time limit was 22x22 (484 nodes, 16786 edges). For the binary graphs, the largest file solved correctly was 7 bits (128 nodes, 1792 edges).

    Each data set was worth a maximum of 50 points. The points available were assigned by hand based on the largest data file that could be solved correctly in five minutes or less. If multiple entries reached the same maximum file size within the given time limit, these were ranked by shortest execution time. Entries that did not generate the correct answer on the smallest data set or had compile or runtime issues received zero points for that collection of test data. Several entries were not threaded and were penalized 50 points.

    There were 15 submissions of code solutions, 7 on Linux and 8 on Windows. There was one entry written in Cilk++, two in C#, and the rest in C/C++.

    Point spread:

    94
    83 82
    73
    63
    39 31
    21
    8
    0(6)

    The write-up portion of each entry was read and scored by two judges. Each judge used the 10-30-10 breakdown of points for serial algorithm description, parallel algorithm description, and performance, respectively. One important component to the judging was to determine how close the submission was for publication on ISN. The assigned score was the average of the two judges scores.

    Point spread:

    48 46
    39 35 30 30
    15
    9 9

    Bonus points were given for contestant’s forum posts made before the problem entries were closed. Five points per post (maximum 25 points possible) were awarded.

    The overall winner was BradleyKuszmaul. The two fastest code executions on the biggest problem sizes tested were submitted by avparate and Sean Lee, and the highest scoring write-up was submitted by Waiting4you.

    --clay

    Congratulations Bradley!

    Good job Avinash, Sean.

    Anyone interested in having a look at my unofficial scoreboard obtained from the following link?
    http://software.intel.com/en-us/contests/Threading-Challenge-2009/contest_services.php?count=1000&contestid=32&r=1


    BradleyKuszmaulDecember 4, 2009 4:54 AM PST
    Rate
     
    Re: Scoring Criteria

    Quoting - akki

    Congratulations Bradley!

    Good job Avinash, Sean.

    Anyone interested in having a look at my unofficial scoreboard obtained from the following link?
    http://software.intel.com/en-us/contests/Threading-Challenge-2009/contest_services.php?count=1000&contestid=32&r=1
    Thanks Akki.

    How did you calculate the scores?  I don't even know my own scores based on these posts.  I there a listing somewhere that I don't know about?

    -Bradley



    akkiDecember 4, 2009 7:41 AM PST
    Rate
     
    Re: Scoring Criteria

    Quoting - BradleyKuszmaul
    Thanks Akki.

    How did you calculate the scores?  I don't even know my own scores based on these posts.  I there a listing somewhere that I don't know about?

    -Bradley


    the score is cumulative. they keep adding your new score to the old one. you'll only know your score if you've recorded the updates after the results for each problem are posted.

    here's the link http://spreadsheets.google.com/ccc?key=0ApQuVEyAdl3LdFJwTUFsUTVOM2ZRUVJHSVMxVFFYZmc&hl=en

    please bear in mind, this is unofficial and may be inaccurate.


    BradleyKuszmaulDecember 4, 2009 7:54 AM PST
    Rate
     
    Re: Scoring Criteria

    Quoting - akki

    the score is cumulative. they keep adding your new score to the old one. you'll only know your score if you've recorded the updates after the results for each problem are posted.

    here's the link http://spreadsheets.google.com/ccc?key=0ApQuVEyAdl3LdFJwTUFsUTVOM2ZRUVJHSVMxVFFYZmc&hl=en

    please bear in mind, this is unofficial and may be inaccurate.
    But where is my cumulative score found?


    avparateDecember 4, 2009 8:42 AM PST
    Rate
     
    Re: Scoring Criteria

    Quoting - akki

    Congratulations Bradley!

    Good job Avinash, Sean.

    Anyone interested in having a look at my unofficial scoreboard obtained from the following link?
    http://software.intel.com/en-us/contests/Threading-Challenge-2009/contest_services.php?count=1000&contestid=32&r=1
    Hey Thanks Akki. Looking forward for next Phase of next year.


    akkiDecember 4, 2009 8:43 AM PST
    Rate
     
    Re: Scoring Criteria

    Quoting - BradleyKuszmaul
    But where is my cumulative score found?
    the cumulative score is here:
    http://software.intel.com/en-us/contests/Threading-Challenge-2009/contest_services.php?count=1000&contestid=32&r=1

    but it's disguised. it's like you get 100 additional points for each submission and 200 instead of 100 for every 4th submission. so, if you have 2256 from 8 submissions (including those in phase 1) then your cumulative score would be 2256 -100 * 6 - 200 * 2 = 2256 - 1000 = 1256


Forum jump:  

Intel Software Network Forums Statistics

17,025 users have contributed to 48,317 threads and 172,754 posts to date.

In the past 24 hours, we have 9 new thread(s) 56 new posts(s), and 52 new user(s).

In the past 3 days, the most popular thread for everyone has been How to manage rounding by IVF ?? The most posts were made to Most likely, the issue is that The post with the most views is Optimalization of sine function\'s taylor expansion

Please welcome our newest member redfruit83


For more complete information about compiler optimizations, see our Optimization Notice.