Final Leaderboard

We are happy to announce the winners of the first part of 15th ECML PKDD Discovery Challenge. In total 17 teams participated in the competition, setting new standards for the new recommendation task of recommending given names. A broad variety of recommendation techniques has been applied and adapted to this new kind of data, ranging from classical collaborative filtering approaches and association rule mining to advanced factorization machines.

Pos Diff Team Name Score
1

uefs.br 0,0491
2

ibayer 0,0472
3

all your base 0,0423
4

Labic 0,0379
5

cadejo 0,0367
6

disc 0,0340
7

Context 0,0321
8

TomFu 0,0309
9

Cibal 0,0262
10

thalesfc 0,0253
11

Prefix 0,0203
12

Gut_und_Guenstig 0,0169
13

TeamUFCG 0,0156
14

PwrInfZC 0,0130
15

persona-non-data 0,0043
16

erick_oliv 0,0021
17

Chanjo 0,0016

Although the challenge’s evaluation scores indicate a leadership, the results are very close. At the workshop we will present and discuss a thorough evaluation and comparison of the different recommendations.

We are looking forward to see different recommender systems in the online challenge!

16th Leaderboard

There it is, our last public leaderboard. Team ‘uefs.br’ did an awesome job again and increased its score by 12 %! The other teams did also a good job increasing their scores and, who knows, maybe they are on top on the final non-public leaderboard. So, who dares to submit new results? Faites vos jeux!

P.S.: The submission for your workshop paper is open!
P.P.S.: Don’t miss the chance to test your recommender in the online challenge!

Pos Diff Team Name Score
1

uefs.br 0,0491
2

ibayer 0,0425
3

all your base 0,0423
4

Labic 0,0379
5

cadejo 0,0363
6

disc 0,0346
7

Context 0,0321
8

TomFu 0,0309
9

Cibal 0,0262
10

thalesfc 0,0253
11

Prefix 0,0203
12

Gut_und_Guenstig 0,0169
13

TeamUFCG 0,0156
14

PwrInfZC 0,0130
15

persona-non-data 0,0043
16

erick_oliv 0,0020

15th Leaderboard v2

The first version of the 15th leaderboards was calculated witch switched results. The current scores where handles as the recent ones and vise versa. This was the reason why no score has changed, but the rank arrows indicated change.
We apologize for this inconvenience and wish you good luck for the board of tomorrow (which will be handled with maximum care of course).

Pos Diff Team Name Score
1

uefs.br 0,0440
2

all your base 0,0419
3

Labic 0,0377
4

ibayer 0,0368
5

cadejo 0,0352
6

Context 0,0321
7

disc 0,0319
8

TomFu 0,0309
9

thalesfc 0,0253
10

Cibal 0,0237
11

Prefix 0,0203
12

TeamUFCG 0,0156
13

PwrInfZC 0,0130
14

persona-non-data 0,0043
15

erick_oliv 0,0020

15th Leaderboard (update)

We too are nervous due to the approaching end of the offline challenge… So please excuse us that the 15th Leaderboard was somehow buggy.

As every minute counts, I quickly list the raw (unsorted) evaluation results:

TeamUFCG	0.0155641
all your base	0.0419351
cadejo	0.035161
Context	0.0320674
disc	0.0319087
erick_oliv	0.00202396
Cibal	0.0237294
PwrInfZC	0.0130255
ibayer	0.036774
Labic	0.037668
persona-non-data	0.00429523
Prefix	0.0202982
uefs.br	0.0440161
thalesfc	0.0252773
TomFu   0.0308609

We are terribly sorry about this! Nevertheless: Keep on crunching! Meanwhile: Why not play around with the short coming name recommendation feature in Nameling: http://beta.nameling.net/name/John (look at the dynamically loaded recommendation box on the sidebar). Currently, there is a NameRank-Based recommender and a dummy recommender integrated – which one did you get? ;-)

I’m finishing the UI integration of the recommender during this and the next week – and I’m looking forward to integrate your recommendations in the system!

15th Leaderboard

This is almost the last leaderboard. Keep in mind that the next will be the last public one. So, submit till Friday 2:00 PM if you want to know the performance of your recommender!

Pos Diff Team Name Score
1

uefs.br 0,0440
2

all your base 0,0405
3

Context 0,0322
4

disc 0,0319
5

cadejo 0,0311
6

TomFu 0,0309
7

Labic 0,0298
8

ibayer 0,0259
9

Cibal 0,0254
10

thalesfc 0,0253
11

TeamUFCG 0,0156
12

PwrInfZC 0,0130
13

Prefix 0,0118
14

persona-non-data 0,0043
15

erick_oliv 0,0020

14th Leaderboard

The leader is dead, long live the leader!

The final phase of our offline challenge is thrilling. There is a new leader just three days after the last board. Team “uefs.br” ditched team “all your base” from the throne with an incredible 18.9 % increase of their last score. That is event 9.2 % more than the last winning score. Com on teams, give your best in this last week of our offline challenge and submit more winning results!

Breaking news: As of today you can read the new description of our online challenge starting at 15th of July.

Pos Diff Team Name Score
1

uefs.br 0,0440
2

all your base 0,0405
3

Context 0,0322
4

disc 0,0319
5

cadejo 0,0311
6

TomFu 0,0309
7

Labic 0,0298
8

ibayer 0,0259
9

Cibal 0,0254
10

thalesfc 0,0253
11

TeamUFCG 0,0156
12

PwrInfZC 0,0130
13

Prefix 0,0118
14

persona-non-data 0,0043
15

erick_oliv 0,0020

13th Leaderboard

During this week, we announced that there will be a new leader. This tweet referred to team “uefs.br”, which did an awesome job with their recommendation. However, the prediction of a new leader was based on the submission that we received till Wednesday, but team “all your base” managed to improve their result even more.

As the deadline of the offline challenge steadily approaches, we will publish additional leaderboards within the next ten days. Altogether, four leaderboards will be published until the end of the offline challenge:

  • Friday, June 21st
  • Monday, June 24th
  • Wednesday, June 26th
  • Friday, June 28th

The leaderboard will be based on the latest submissions until 14:00h (CET) of the respective date. Your final submission is due on July 1st, 23:59h (HAST – Hawaii-Aleutian Standard Time).

Pos Diff Team Name Score
1

all your base 0,0406
2

uefs.br 0,0370
3

Context 0,0325
4

TomFu 0,0309
5

cadejo 0,0300
6

Labic 0,0296
7

disc 0,0290
8

ibayer 0,0259
9

thalesfc 0,0199
10

TeamUFCG 0,0156
11

PwrInfZC 0,0130
12

Prefix 0,0048
13

persona-non-data 0,0043
14

erick_oliv 0,0020

12th Leaderboard

It is very exciting. All top three teams have improved their scores. In the middle, team Labic and cadejo move upwards as well. We also welcome a new team at the bottom of our board: Prefix! We are looking forward to next weeks leaderboard.

Your 20DC13 team.

Pos Diff Team Name Score
1

all your base 0,0362
2

disc 0,0325
3

Context 0,0325
4

TomFu 0,0309
5

Labic 0,0296
6

sertão 0,0296
7

cadejo 0,0259
8

ibayer 0,0259
9

thalesfc 0,0199
10

TeamUFCG 0,0156
11

PwrInfZC 0,0130
12

Prefix 0,0048
13

persona-non-data 0,0043

11th Leaderboard

A new team rushed to the top of our leaderboard. Close behind is team disc who improved their score every week since they started on the leaderboard. With this speed of progress, they will be on top of the leaderboard until next week. We are waiting the next recommender result submission for the coming leaderboard.

Pos Diff Team Name Score
1

all your base 0,0357
2

disc 0,0324
3

Context 0,0318
4

TomFu 0,0309
5

sertão 0,0296
6

Labic 0,0291
7

ibayer 0,0259
8

cadejo 0,0200
9

thalesfc 0,0199
10

TeamUFCG 0,0156
11

PwrInfZC 0,0130
12

persona-non-data 0,0043

10th Leaderboard

We enter the last month for the offline challenge a bit later, but with a leaderboard full of changes. First of all, we welcome the new team Labic, which rushed up to the 3rd place. Team disc was also successful, improving their score from 0.0242 to 0.0261. We are waiting the next recommender result submission for the coming leaderboard.

Pos Diff Team Name Score
1

Context 0,0318
2

TomFu 0,0309
3

Labic 0,0291
4

disc 0,0261
5

sertão 0,0234
6

cadejo 0,0199
7

thalesfc 0,0199
8

TeamUFCG 0,0156
9

PwrInfZC 0,0130
10

persona-non-data 0,0043