I'm fairly certain that for my Q8 (2 squares, 2 circles & 2 triangles on each), there was no unique odd one out. For A & C the triangles pointed opposite directions when assembled, and B & D they pointed in the same direction.
My head hurts now. An interesting test of one's ability to hold a detailed object in short term memory while confusing yourself with speculations and arguments... Knowing psychologists, though, the real test was probably something quite different.
If it was being timed, perhaps I shouldn't have gone and made myself a coffee halfway through.
Hmmm, 2 out of 9 and no feedback? I have to say I find that deeply frustrating :)
Also, I have no idea what you're collecting data for or anything; I just gave you my time, please let me know what you've done with it. Hope you get the results you wanted.
Edit: Apparently I scored 8/9, which is less frustrating :)
This is for a psych project. It is quite a bit harder than most spatial ability tests. Most spatial ability tests are easy to do with non-spatial methods. We have designed this item format to (hopefully) not be the case.
Our results so far have shown that not having a time limit doesn't affect the results substantially either, unlike most other spatial tests. It is a test of what you are able to do rather than how quickly you can do something.
Thanks, that's cool. Yeah, I had to manually rotate things in my mind to solve it, although there are a few where the sequences give it away, e.g. 5 the arrow points away from the cross.
Holy shit. I managed to focus for four, got told I only had one right, which surprises me. That may very well be the hardest reasoning test I've ever seen.
This is excruciatingly difficult. I have no experience with this sort of a test, and the method that I chose (albeit quickly and without a whole lot of thought) was to pick four sides that were touching, and try to find the one pattern that didn't have the same four sides touching.
This logic obviously didn't work, because I got 1 / 9. Does anyone have a strategy for this, or is it pure logic?
For those of you that took the test earlier, go to http://psych.io/spatial/scores.php for your correct score. It will work as long as you have the same IP as beofre. Sorry again about the mix up to start.
And thankyou so much to everyone that is doing this!
Hm. I might have "cheated" on this. I haven't tried to imagine the actual 2D->3D transformations but instead looked for clues in the 2D images. It's a bit hard to describe - transforming the cutouts in my head so that they match (or obviously differ) in 2D while still giving the same cube.
Did not submit though, since I got tired after the 4th set.
All spatial tests are able to be solved with structural techniques rather than spatial ones.
We have designed this test in response to that flaw so that when it comes to the harder items it is much more difficult to do so than to use the intended mental transformation and rotation techniques.
Partially failed with me. I had to think of more and more elaborate transformation techniques over time, however, and apparently that failed for one test (I got 8 out of 9) (I really would have liked to know where I screwed up, though you may be afraid that cheating skews your results).
But, to come up with those "cheats", I had to imagine the 3D cube folding before me. Number 6 in particular had me do a more thorough analysis than most (but I still came up with a way to cheat, then used it).
I found the easiest way to do this test was to first find something the uniquely determined the the the position and rotation of the cube. Then I would see which edges were adjacent by folding in my head. I would use this to gradually construct a
010
111
010
010
canonical 2d picture of one picture. I would then compare the others to this one.
I couldn't hold a 3d picture in memory. 2d and graphs on the other hand..
4/9. I was fighting impatience for a good deal of the time. This may be intentional, but if not, some added context as to the purpose may have given me more reason to focus. Or not ;-)
Agreed, same here. SPOILER The consensus seems to be that 8 has more than one answer, I definitely see 8A as different from the others (arrows pointing away from each other as opposed to perpendicular), but perhaps there is another one. Brain is too tired to figure out another possibility right now; thanks for the workout :)
BTW #6 I found most difficult (even more so than #9), and #7 was far too easy for its position.
TO AUTHOR: The answer key for #6 is wrong. It should be A, not C. (The boxes are on the LHS of the frontmost arrow in A; they are on the RHS of the other three.)
I'm not sure it takes into consideration the orientation of the image, I was using that as a short cut - E.G. arrow points to circle and such.
This made about half of them solvable by inspection in under 15 seconds for me. However the result was 1 out of 9. Using this same approach the 8th question was obviously flawed, I wasn't about to go back and try a different method at that point though.
I originally uploaded the incorrect items, of which one contained a flaw (I scored it as correct for everyone in that early group).
In the easy questions you can indeed use those structural techniques, but in the harder ones you couldn't.
In the 'gold standard' spatial tests that currently exist you can use these kinds of queues for almost every item very easily, which is why we introduced this method.
Also, we need to take into account the vastly higher than average intelligence at HN compared to the general population; you guys are outrageously outperforming undergraduate psych students so far :-)
The tests that have only different symbols are much easier than the ones where symbols are repeated.
For example for question 1, without actually building the whole of the cube in one's head, it's quite obvious that the circle is always on the left side of the heart, except in one case where it will be at the top, and since the cubes have to be absolutely identical one doesn't need to look further than the first difference.
(Edit: if the test is different for each taker, the above example is meaningless, of course.)
We had some requirements for the test which included graded difficulty from very easy to very hard to be able to separate out people of different abilities over a regular population.
We were supposed to design the first question so that 100% of people got it correct; to be an easy, practice type question.
The trick of pairing opposite faces to create a 3-tuple of directions drawn from {opposite,same,sideways} for each cube makes this possible to answer without much spatial reasoning.
Without any tricks I find it hard to believe anyone can do this one. It'd be hard to find a different holding the solid cubes.
Really hard indeed!. Mind blowing. At first I thought C but then I cheated ( it is hard even cheating...) and drawing the diferent posibilities I only see A=D and B=C. I dOn't know what I am missing.
I found all of them very easy except "question 6", at which I'm still failing hard to visualize the difference, and is the only one I got wrong. (I had to choose a random one)
I may as well link you guys to http://cube.asher.io as well. It only works in chrome though! It is a web page that I banged up in a night that we used to create the items. No instructions on it though - try drag and drop :D
65 comments
[ 2.7 ms ] story [ 76.8 ms ] threadI'm fairly certain that for my Q8 (2 squares, 2 circles & 2 triangles on each), there was no unique odd one out. For A & C the triangles pointed opposite directions when assembled, and B & D they pointed in the same direction.
If it was being timed, perhaps I shouldn't have gone and made myself a coffee halfway through.
My greatest apologies for those who didn't get a correct score back, ill put up your scores with the last half of your IP addresses very soon!
Also, I have no idea what you're collecting data for or anything; I just gave you my time, please let me know what you've done with it. Hope you get the results you wanted.
Edit: Apparently I scored 8/9, which is less frustrating :)
Our results so far have shown that not having a time limit doesn't affect the results substantially either, unlike most other spatial tests. It is a test of what you are able to do rather than how quickly you can do something.
This logic obviously didn't work, because I got 1 / 9. Does anyone have a strategy for this, or is it pure logic?
This didn't work for exactly 3 of them (the ones with repeated symbols), so went with educated guesses there.
Curiously, I got 6/9.
And thankyou so much to everyone that is doing this!
. . .
Hm. I might have "cheated" on this. I haven't tried to imagine the actual 2D->3D transformations but instead looked for clues in the 2D images. It's a bit hard to describe - transforming the cutouts in my head so that they match (or obviously differ) in 2D while still giving the same cube.
Did not submit though, since I got tired after the 4th set.
We have designed this test in response to that flaw so that when it comes to the harder items it is much more difficult to do so than to use the intended mental transformation and rotation techniques.
But, to come up with those "cheats", I had to imagine the 3D cube folding before me. Number 6 in particular had me do a more thorough analysis than most (but I still came up with a way to cheat, then used it).
I couldn't hold a 3d picture in memory. 2d and graphs on the other hand..
8/9 points
BTW #6 I found most difficult (even more so than #9), and #7 was far too easy for its position.
TO AUTHOR: The answer key for #6 is wrong. It should be A, not C. (The boxes are on the LHS of the frontmost arrow in A; they are on the RHS of the other three.)
Proof: https://imgur.com/a/rH5kW
It seems to be giving feedback now, 7/9. As others have said, for our own curiousness it would have been nice to know which ones we got wrong!
This made about half of them solvable by inspection in under 15 seconds for me. However the result was 1 out of 9. Using this same approach the 8th question was obviously flawed, I wasn't about to go back and try a different method at that point though.
In the easy questions you can indeed use those structural techniques, but in the harder ones you couldn't.
In the 'gold standard' spatial tests that currently exist you can use these kinds of queues for almost every item very easily, which is why we introduced this method.
Also, we need to take into account the vastly higher than average intelligence at HN compared to the general population; you guys are outrageously outperforming undergraduate psych students so far :-)
A pity the test didn't say which ones I failed, though.
The tests that have only different symbols are much easier than the ones where symbols are repeated.
For example for question 1, without actually building the whole of the cube in one's head, it's quite obvious that the circle is always on the left side of the heart, except in one case where it will be at the top, and since the cubes have to be absolutely identical one doesn't need to look further than the first difference.
(Edit: if the test is different for each taker, the above example is meaningless, of course.)
We had some requirements for the test which included graded difficulty from very easy to very hard to be able to separate out people of different abilities over a regular population.
We were supposed to design the first question so that 100% of people got it correct; to be an easy, practice type question.
Also, you guys aren't even getting to see our hardest questions :D Take a look at http://psych.io/spatial/hard.jpg for example!
Without any tricks I find it hard to believe anyone can do this one. It'd be hard to find a different holding the solid cubes.
http://imgur.com/VyW30