Forum Jump

Select Group :
Select Forum :
Sorted By :
Sort Order :
From The :
 
Thread Tools  Search this thread 
Clay Breshears (Intel)
Total Points:
15,225
Status Points:
15,225
Black Belt
June 9, 2009 8:07 AM PDT
Scoring Criteria
Three test cases were used to judge execution speed.  The first had 100,000 keys to search through and 20 keys to search for.  In the second file 10 of these were contained in the data file and 10 were not.  The second and third test cases had a search space of 100,000,000 keys; the number of keys to be searched was 100,000 in both cases.  One search file had 20 good keys repeated 5000 times and the other had 100K keys that were not contained in the search space. 

A maximum of five minutes overall was set for each test case. The maximum time recorded for those entries that encountered runtime errors or other execution problems was 60 seconds (since the time was only for searching and printing the results.  A penalty of 15 points per test case was levied for any results that had incorrect results (finding keys not within the data, not finding keys within the data, etc.).  The sum of the three test case runtimes was compared to the minimum overall time and execution points were assigned linearly based on the difference.

There were 24 submissions of code solutions, 6 on Linux and 16 on Windows. There was one entry written in Java, one in C#, one in Erlang, and the rest in C/C++. Thirteen entries had runtime issues, especially in the last two test cases.
Point spread:

100
99 99 99 99 99 99 98 93
75
69
33 33 33 33 33 33
18 18
0 0 0 0 0 0

The write-up portion of each entry was read and scored by two judges. Each judge used the 10-30-10 breakdown of points for serial algorithm description, parallel algorithm description, and performance, respectively. One important component to the judging was to determine how close the submission was for publication on ISN. The assigned score was the average of the two judges scores.

Point spread:

44 43
37 36 33 32
29 28 24 24
19 17 16 14 14 12 11 11 10
7 4
0 0 0 0

Bonus points were given for contestant’s forum posts made before the problem entries were closed. Five points per post (maximum 25 points possible) were awarded.

The overall winner was denghui0815, who also had the fastest code execution.  The highest scoring write-up was submitted by Dmitriy Vyukov.
dweeberlyloom
Total Points:
6,630
Status Points:
6,130
Brown Belt
June 9, 2009 5:52 PM PDT
Rate
 
#1
Three test cases were used to judge execution speed.  The first had 100,000 keys to search through and 20 keys to search for.  In the second file 10 of these were contained in the data file and 10 were not.  The second and third test cases had a search space of 100,000,000 keys; the number of keys to be searched was 100,000 in both cases.  One search file had 20 good keys repeated 5000 times and the other had 100K keys that were not contained in the search space. 

A maximum of five minutes overall was set for each test case. The maximum time recorded for those entries that encountered runtime errors or other execution problems was 60 seconds (since the time was only for searching and printing the results.  A penalty of 15 points per test case was levied for any results that had incorrect results (finding keys not within the data, not finding keys within the data, etc.).  The sum of the three test case runtimes was compared to the minimum overall time and execution points were assigned linearly based on the difference.

There were 24 submissions of code solutions, 6 on Linux and 16 on Windows. There was one entry written in Java, one in C#, one in Erlang, and the rest in C/C++. Thirteen entries had runtime issues, especially in the last two test cases.
Point spread:

100
99 99 99 99 99 99 98 93
75
69
33 33 33 33 33 33
18 18
0 0 0 0 0 0

The write-up portion of each entry was read and scored by two judges. Each judge used the 10-30-10 breakdown of points for serial algorithm description, parallel algorithm description, and performance, respectively. One important component to the judging was to determine how close the submission was for publication on ISN. The assigned score was the average of the two judges scores.

Point spread:

44 43
37 36 33 32
29 28 24 24
19 17 16 14 14 12 11 11 10
7 4
0 0 0 0

Bonus points were given for contestant’s forum posts made before the problem entries were closed. Five points per post (maximum 25 points possible) were awarded.

The overall winner was denghui0815, who also had the fastest code execution.  The highest scoring write-up was submitted by Dmitriy Vyukov.

Would still love to have a way to find out my score so I could assess what I was doing right/wrong.

akki
Total Points:
2,720
Status Points:
2,220
Brown Belt
June 9, 2009 11:01 PM PDT
Rate
 
#2 Reply to #1
Quoting - dweeberlyloom

Would still love to have a way to find out my score so I could assess what I was doing right/wrong.

So would I...


Here's my interpretation of the scores:
http://spreadsheets.google.com/ccc?key=rRPX2nM92vYSLUPDmjQgF7A

I do not guarantee accuracy but it's the best we have at the moment.


邓辉
Total Points:
3,850
Status Points:
3,350
Brown Belt
June 10, 2009 4:58 AM PDT
Rate
 
#3 Reply to #2
Quoting - akki

So would I...


Here's my interpretation of the scores:
http://spreadsheets.google.com/ccc?key=rRPX2nM92vYSLUPDmjQgF7A

I do not guarantee accuracy but it's the best we have at the moment.

You sorted out the statements。 thanks!
--------
写字楼里写字间,写字间里程序员
程序人员写程序,又拿程序换酒钱
酒醒只在网上坐,酒醉还来网下眠
酒醉酒醒日复日,网上网下年复年


Dmitriy Vyukov
Total Points:
25,462
Status Points:
25,462
Black Belt
June 10, 2009 10:19 AM PDT
Rate
 
#4
Three test cases were used to judge execution speed.  The first had 100,000 keys to search through and 20 keys to search for.  In the second file 10 of these were contained in the data file and 10 were not.  The second and third test cases had a search space of 100,000,000 keys; the number of keys to be searched was 100,000 in both cases.  One search file had 20 good keys repeated 5000 times and the other had 100K keys that were not contained in the search space. 


Clay, please attach input files used for scoring.
In his blog denghui0815 write that his execution time for 10Mx10M input is 6.81s, while my is 0.61s. There is some difference in our machines and we use different input files, but I want to investigate it anyway.



akki
Total Points:
2,720
Status Points:
2,220
Brown Belt
June 11, 2009 11:22 PM PDT
Rate
 
#5 Reply to #3
Quoting - denghui0815

You sorted out the statements。 thanks!

:D... well someone had to do it...

The organizers don't seem very interested in the task, so I thought why not me. I had to find out where I stand... ;)


houzhe
Total Points:
460
Status Points:
410
Green Belt
June 12, 2009 4:28 AM PDT
Rate
 
#6 Reply to #1
Quoting - dweeberlyloom

Would still love to have a way to find out my score so I could assess what I was doing right/wrong.

Hi,

Sorry. Who can tell me why did not get any point for this testing? I just suspect whether my solution is really evaluated by anybody? Thanks.

 Best regards,

HouZhe

houzhe
Total Points:
460
Status Points:
410
Green Belt
June 12, 2009 4:29 AM PDT
Rate
 
#7 Reply to #1
Quoting - dweeberlyloom

Would still love to have a way to find out my score so I could assess what I was doing right/wrong.

Hi,

Sorry. Who can tell me why I did not get any point for this testing? I just suspect whether my solution is really evaluated by anybody? Thanks.

 Best regards,

HouZhe

houzhe
Total Points:
460
Status Points:
410
Green Belt
June 12, 2009 4:31 AM PDT
Rate
 
#8 Reply to #1
Quoting - dweeberlyloom

Would still love to have a way to find out my score so I could assess what I was doing right/wrong.

Hi,

Sorry. Who can tell me why I did not get any point for this testing? I just suspect whether my solution is really evaluated by anybody? Thanks.

 Best regards,

HouZhe

mikhailsemenov
Total Points:
715
Status Points:
215
Brown Belt
June 12, 2009 5:15 AM PDT
Rate
 
#9
Three test cases were used to judge execution speed.  The first had 100,000 keys to search through and 20 keys to search for.  In the second file 10 of these were contained in the data file and 10 were not.  The second and third test cases had a search space of 100,000,000 keys; the number of keys to be searched was 100,000 in both cases.  One search file had 20 good keys repeated 5000 times and the other had 100K keys that were not contained in the search space. 

A maximum of five minutes overall was set for each test case. The maximum time recorded for those entries that encountered runtime errors or other execution problems was 60 seconds (since the time was only for searching and printing the results.  A penalty of 15 points per test case was levied for any results that had incorrect results (finding keys not within the data, not finding keys within the data, etc.).  The sum of the three test case runtimes was compared to the minimum overall time and execution points were assigned linearly based on the difference.

There were 24 submissions of code solutions, 6 on Linux and 16 on Windows. There was one entry written in Java, one in C#, one in Erlang, and the rest in C/C++. Thirteen entries had runtime issues, especially in the last two test cases.
Point spread:

100
99 99 99 99 99 99 98 93
75
69
33 33 33 33 33 33
18 18
0 0 0 0 0 0

The write-up portion of each entry was read and scored by two judges. Each judge used the 10-30-10 breakdown of points for serial algorithm description, parallel algorithm description, and performance, respectively. One important component to the judging was to determine how close the submission was for publication on ISN. The assigned score was the average of the two judges scores.

Point spread:

44 43
37 36 33 32
29 28 24 24
19 17 16 14 14 12 11 11 10
7 4
0 0 0 0

Bonus points were given for contestant’s forum posts made before the problem entries were closed. Five points per post (maximum 25 points possible) were awarded.

The overall winner was denghui0815, who also had the fastest code execution.  The highest scoring write-up was submitted by Dmitriy Vyukov.

I have a similar question. Is it possible to find out about the score, where I did wrong and also whether anybody looked at the files that I uploaded into the folder with the Problem Name.  Or maybe I had to specify which files should be used when I submitted the solution.  Any feedback will be very helpful.



Intel Software Network Forums Statistics

8488 users have contributed to 31627 threads and 100752 posts to date.
In the past 24 hours, we have 33 new thread(s) 138 new posts(s), and 198 new user(s).

In the past 3 days, the most popular thread for everyone has been gemm(A,A,A) like possible? The most posts were made to Crash when loading skeleton The post with the most views is Dear Steve, excuse me for a d

Please welcome our newest member chat1983