MOTES Original Thinking Test; API Limit Increases
Hey everybody, I wanted to drop a few tiny updates on Open Creativity Scoring.
I love hearing from researchers who are using Open Creativity Scoring, and really want to reduce the friction of using it. To that end, I'm loosening all the limits of use with and without the API key. That key system is only in place to prevent misuse while allowing it to be publically available. I'm doubling the limits without an API key and tripling the use with an API key.
Limits without an API key:
- Before: 1000 responses/hour, 6k/day, 15k/week
- Now: 2000 responses/hour, 12k/day, 30k/week
Limits with an API key:
- Before: 2k responses/hour, 20k/day, 40k/week
- Now: 6k responses/hour, 60k/day, 120k/week
These are just the defaults, and I can loosen API key limits on request.
Often when you're working in large batches, it's better to do it programmatically than using the website, because you have more control over network errors or other oddities. I understand that adds some complexity, but feel free to reach out if you're doing something big and you're running into issues that you can't figure out. I have examples I can share, or sometimes I can just score for you. Sometimes it might even help me find a bug.
In the future, I hope to make some of the open models that we've trained available for scoring directly in your browser, scored with your own CPU or GPU. That would preclude the need for any sort of key - if a random malicious bot found it, they'd just be using their own compute cycles!
MOTES
With Selcuk Acar, Denis Dumas, Kelly Berthiaume, and a slew of talented graduate students, we developed the Measure of Original Thinking in Elementary Students (MOTES) over the past few years.
Jacob Turner and I prepared an online demonstration of the test, available here: https://openscoring.du.edu/motes. The default test just shows the practice questions, but you can complete the full test with an access key. Please email me for that; we will gladly share it with researchers or practitioners!
This implementation is primarily demonstrative, and none of the information is on our servers. It's all saved locally on your computer.