A simple system would be something like: - accuracy is most important - if tied on accuracy (ie both got 8/10) then tie break is done on speed
In general, across a lot of games - winning is a big determinant in who comes back. Right now it might be very difficult to beat JEV with the way your scoring is setup.
For my game in particular it's like a 47% chance that a winning player returns versus just 10% for non-winners.
Versus Measures accuracy but under time pressure, if you score more than Jev you will win.
And streak is also accuracy.
This quiz game, is supposed to visualize how good and bad these type of models are. They can be very fast but they can also fail 20% of the times. As a human, can you beat that?
It’s obviously much faster than a human, but it’s interesting that it only got 7/10 right on both rounds (same as me). I’m wondering what Jev could be trusted to do reliably given these results.
I guess it wasn’t optimized for these types of trivia questions. Or maybe the image capabilities are too new and need refinement.
Jev and decision models, can make decisions very fast, in this quiz with around 80% accuracy, each use case will need to define if its good enough or not.
1- I got 7/10, jev got 6/10, and it says Jev won, presumably because I took 100 seconds, but Jev took 60? Funny what that reveals about author and AI-optimism in general
2- The chess board challenge isn't clear on how it should take the answer, I tried dragging a piece but that didn't work, then I tried touching the piece I wanted to move, but it marked the answer wrong, I apparently had to touch the square I needed to move the piece to.
You get very high scores if you are fast and accurate (which Jev is most of the time), and you get punished hard (15s) if you are wrong. The game balances speed and accuracy.
Will try to improve the cards that didnt work for you, thanks for the feedback!
There's notably no button for "I don't know", but if there were, a human would maybe get 7 rights and 3 I don't know. While Jev would probably get 6 rights and 4 wrongs. I get that it's a game, but it's also not.
I think great minds make great efforts to not be wrong, someone that is never wrong is in a different category completely than something that answers fast, or even that answers more correct questions.
I saw several other questions where I pressed the right answer and the app scored me as wrong. Broken slop.
Though if you need very quick answers obviously humans can't compete.
Actually on further thought after getting 15, if you've seen the exact problem before you can answer quickly, so the usefulness is diminished to problems that don't need to be 100% correct, need to be solved very quickly (even routing might not need to be this quick), problem form often changes, but is still general knowledge, and very low marginal benifet for 99% correctness over 50%