Skip to content

Commit 61e42e8

Browse files
Merge pull request #18 from Annotation-Garden/feature/opus-4-8-vision-neuro
Add Claude Opus 4.8 vision_neuro annotations and default
2 parents fb40817 + a3ed9ec commit 61e42e8

1,005 files changed

Lines changed: 22152 additions & 6 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

annotations/nsd/shared0001_nsd02951_annotations.json

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,28 @@
2222
}
2323
},
2424
"annotations": [
25+
{
26+
"model": "claude-opus-4-8",
27+
"temperature": 1.0,
28+
"prompts": {
29+
"vision_neuro": {
30+
"prompt_text": "You are describing a photograph for a neuroscience visual-perception study. Analyze the visual elements and their spatial locations: state which are in the foreground vs background and their position in the frame (left/center/right, upper/lower). Note any interactions between elements (people, animals, objects, scene). Describe the overall color scheme, lighting, and visual composition. Ground every statement in clearly visible detail; do not infer context you cannot see. Write one continuous paragraph, 150-200 words.",
31+
"response": "The photograph depicts an outdoor market scene dominated by a large mound of bright orange carrots occupying the center and lower-center foreground, spread across a dark surface. In the lower-left foreground sit red mesh bags filled with what appear to be onions or produce, and a white woven sack rests at the bottom of the frame. To the left of the carrots, in the mid-ground, are bundles of green vegetables, likely leafy greens or beans. On the right side of the frame, a man wearing a light-colored, long-sleeved shirt and dark pants leans forward over the produce, his hands reaching toward the goods, suggesting he is arranging or selecting items. In the background, positioned center and left, several people stand and move about; one figure wears a blue jacket, another a green shirt, and a woman in the upper-center wears a dark head covering. Market stalls, canopies, and a blue-patterned umbrella occupy the upper portion of the frame. The lighting is bright and natural, consistent with daytime sun, casting shadows on the ground. The overall color scheme combines vivid oranges, reds, and greens against muted browns and neutral tones, creating a busy, layered composition.",
32+
"response_format": "text",
33+
"response_data": null,
34+
"error": null,
35+
"hed_annotation": "Sensory-event, Visual-presentation, Photograph, Outdoors, (Label/Item-count-Some, (Orange, Ingestible-object/Staple-food, Sweet), (Center-of, Foreground-view)), ((Red, Ingestible-object/Staple-food), (Lower-left-of, Foreground-view)), (White, Man-made-object, Label/Woven-sack), ((Green, Ingestible-object/Staple-food), (To-left-of, Foreground-view)), ((Human-agent, Male, (White, Clothing), (Bend, Torso)), Interacts-with, (Ingestible-object/Staple-food)), (Label/Item-count-Some, Human-agent, Background-view), ((Human-agent, (Blue, Clothing)), Background-view), ((Human-agent, (Green, Clothing)), Background-view), ((Human-agent, Female, (Dark-shade, Clothing, Head)), Upper-center-of), (Building-part, Upper-center-of), ((Blue, Pattern, Man-made-object, Label/Umbrella), Upper-center-of), (Light-shade, Luminance), Man-made-object/Market",
36+
"token_metrics": {
37+
"input_tokens": 421,
38+
"output_tokens": 383,
39+
"total_tokens": 804
40+
}
41+
}
42+
},
43+
"metrics": {
44+
"total_tokens": 804
45+
}
46+
},
2547
{
2648
"model": "qwen2.5vl:7b",
2749
"temperature": 0.3,

annotations/nsd/shared0002_nsd02991_annotations.json

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,28 @@
2222
}
2323
},
2424
"annotations": [
25+
{
26+
"model": "claude-opus-4-8",
27+
"temperature": 1.0,
28+
"prompts": {
29+
"vision_neuro": {
30+
"prompt_text": "You are describing a photograph for a neuroscience visual-perception study. Analyze the visual elements and their spatial locations: state which are in the foreground vs background and their position in the frame (left/center/right, upper/lower). Note any interactions between elements (people, animals, objects, scene). Describe the overall color scheme, lighting, and visual composition. Ground every statement in clearly visible detail; do not infer context you cannot see. Write one continuous paragraph, 150-200 words.",
31+
"response": "In the foreground occupying the right and lower-center of the frame, a man wearing a white chef's jacket and a dark blue cap pours liquid from a stainless steel measuring pot into a larger metal stockpot positioned on a stainless steel countertop; directly below and to his right rests a portion of cooked meat, reddish-brown in color, on the metal surface. In the lower-left foreground, a second person in a white chef's jacket over a dark apron leans forward, hands reaching toward a light-colored cardboard box labeled with text including the word \"wrap,\" beside a rectangular metal tray. Both individuals interact with cooking equipment rather than each other. In the background, spanning center to left, are large stainless steel commercial ovens with multiple doors marked by red accents and vertical handles, along with a metallic overhead range hood at the upper portion of the frame from which a hanging utensil, possibly a ladle, is suspended on the upper left. The overall color scheme is dominated by silver and gray metallic tones, white uniforms, and warm ambient lighting reflecting off polished surfaces, creating a balanced, symmetrical composition centered on the two working figures.",
32+
"response_format": "text",
33+
"response_data": null,
34+
"error": null,
35+
"hed_annotation": "Sensory-event, Visual-presentation, ((Human-agent, (Clothing, White), (Clothing, Blue)), (In-front-of, ((Right-side-of, Lower-center-of), Foreground-view))), (Human-agent, (Label/Pour, (Manufactured-material/Metal, Man-made-object/Container))), (((Human-agent), Interacts-with, (Manufactured-material/Metal, Man-made-object/Container))), ((Manufactured-material/Metal, Man-made-object/Container), (Top-of, (Manufactured-material/Metal, Furnishing))), ((Ingestible-object/Main-dish, Savory, Brown), (Below, (Manufactured-material/Metal, Furnishing))), ((Human-agent, (Clothing, White), (Clothing, Black)), ((Lower-left-of, Foreground-view))), (Human-agent, (Reach, (Box, Label/wrap))), (((Human-agent), Interacts-with, (Box, Label/wrap))), ((Rectangle, Manufactured-material/Metal, Furnishing), (Adjacent-to, (Box, Label/wrap))), ((Machine, Manufactured-material/Metal, (Door, Red)), (Background-view, (Center-of, Left-side-of))), ((Furnishing, Manufactured-material/Metal), (Upper-center-of, Background-view)), ((Tool, (Hold-down)), (Upper-left-of, Background-view)), (Silver, Gray, White), Symmetrical",
36+
"token_metrics": {
37+
"input_tokens": 421,
38+
"output_tokens": 380,
39+
"total_tokens": 801
40+
}
41+
}
42+
},
43+
"metrics": {
44+
"total_tokens": 801
45+
}
46+
},
2547
{
2648
"model": "qwen2.5vl:7b",
2749
"temperature": 0.3,

annotations/nsd/shared0003_nsd03050_annotations.json

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,28 @@
2222
}
2323
},
2424
"annotations": [
25+
{
26+
"model": "claude-opus-4-8",
27+
"temperature": 1.0,
28+
"prompts": {
29+
"vision_neuro": {
30+
"prompt_text": "You are describing a photograph for a neuroscience visual-perception study. Analyze the visual elements and their spatial locations: state which are in the foreground vs background and their position in the frame (left/center/right, upper/lower). Note any interactions between elements (people, animals, objects, scene). Describe the overall color scheme, lighting, and visual composition. Ground every statement in clearly visible detail; do not infer context you cannot see. Write one continuous paragraph, 150-200 words.",
31+
"response": "A surfer occupies the center of the frame, standing on a light blue surfboard that sits in the lower-center portion of the image; the person wears a dark navy or black full-body wetsuit and bends forward at the waist with knees flexed and arms extended slightly, balancing in an active riding posture. The surfer's board rests on churning white foam in the mid-lower center, where the wave breaks. A curling wave dominates the middle and right side of the frame, its crest peaking on the right with white spray and foam cascading down its face, while the left side shows a smoother teal-green wave wall in the foreground. The background upper portion displays deeper, darker blue-gray open ocean water with a slightly textured surface. The overall color scheme is dominated by cool tones\u2014turquoise, teal, navy, and white foam\u2014creating a monochromatic aquatic palette. Lighting appears bright and natural, likely daytime sunlight, casting mild highlights on the wave crest and the surfer's wetsuit. Compositionally, the surfer serves as the central focal point, framed between the breaking wave on the right and the descending wave slope on the left, creating diagonal movement across the frame.",
32+
"response_format": "text",
33+
"response_data": null,
34+
"error": null,
35+
"hed_annotation": "Sensory-event, Visual-presentation, ((Human-agent, Experiment-participant), (Ride, ((Light-shade, Blue, Item/Surfboard), Lower-center-of))), (Human-agent, (Clothing, Label/Wetsuit, Black)), (Human-agent, Bend, (Knee, Flex)), ((Item/Surfboard), (Contained-in, (White, Natural-feature/Foam, Center-of))), (Label/Item-Wave, Right-side-of, (White, Item/Spray)), (Label/Item-Wave, Left-side-of, (Teal, Green, Foreground-view)), (Blue-color, Gray, Background-view, Natural-feature/Water), (Turquoise, Teal, Navy, White), Outdoors, (Natural-feature/Ocean, Background-view)",
36+
"token_metrics": {
37+
"input_tokens": 421,
38+
"output_tokens": 378,
39+
"total_tokens": 799
40+
}
41+
}
42+
},
43+
"metrics": {
44+
"total_tokens": 799
45+
}
46+
},
2547
{
2648
"model": "qwen2.5vl:7b",
2749
"temperature": 0.3,

annotations/nsd/shared0004_nsd03078_annotations.json

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,28 @@
2222
}
2323
},
2424
"annotations": [
25+
{
26+
"model": "claude-opus-4-8",
27+
"temperature": 1.0,
28+
"prompts": {
29+
"vision_neuro": {
30+
"prompt_text": "You are describing a photograph for a neuroscience visual-perception study. Analyze the visual elements and their spatial locations: state which are in the foreground vs background and their position in the frame (left/center/right, upper/lower). Note any interactions between elements (people, animals, objects, scene). Describe the overall color scheme, lighting, and visual composition. Ground every statement in clearly visible detail; do not infer context you cannot see. Write one continuous paragraph, 150-200 words.",
31+
"response": "In the immediate foreground occupying the lower portion of the frame lies a gray-brown sandy beach, upon which rest three kayaks arranged horizontally across the bottom edge: a red-and-orange kayak on the left, a bright orange kayak in the lower center, and a red kayak on the lower right. Behind them in the middle ground stretches a broad expanse of gray-blue water with a shimmering, light-reflective surface. Centered in this water, slightly right of the frame's middle, stands a person on a windsurf board, gripping a tall sail composed of vivid pink, blue, cyan, and yellow panels; the sail rises vertically into the upper-center region and is the most saturated color element. In the background, filling the upper half of the frame, are rolling hills covered in dark green vegetation on the left and dry, tan-golden grassy slopes toward the upper right, indicating bright daylight. The lighting appears natural and strong, casting sparkling highlights on the water. The overall composition is horizontally layered\u2014beach, water, hills\u2014with a muted natural palette of greens, tans, and grays punctuated by the saturated kayaks and sail.",
32+
"response_format": "text",
33+
"response_data": null,
34+
"error": null,
35+
"hed_annotation": "Sensory-event, Visual-presentation, Outdoors, Real-world, Natural-object, (Foreground-view, (Dirt-terrain, Gray, Brown), (Lower-center-of, Image)), (Item-count/3, (Boat, Red, Orange)), ((Boat, Red, Orange), (Left-side-of, Image)), ((Boat, Orange), (Lower-center-of, Image)), ((Boat, Red), (Lower-right-of, Image)), (Background-view, (River, Gray, Blue, Label/Luminance-contrast-High), (Center-of, Image)), ((Human-agent, Standing), Interacts-with, (Boat, (Center-of, Image))), ((Human-agent), (Grasp, (Item, Pink, Blue, Cyan, Yellow, Vertically-oriented, (Upper-center-of, Image)))), (Background-view, (Hill, Green, Dark-shade), (Upper-left-of, Image)), (Background-view, (Grassy-terrain, Tan, Yellow), (Upper-right-of, Image)), (Label/Luminance-High, Luminance/Daytime), (Natural-feature/Beach, Foreground-view)",
36+
"token_metrics": {
37+
"input_tokens": 421,
38+
"output_tokens": 375,
39+
"total_tokens": 796
40+
}
41+
}
42+
},
43+
"metrics": {
44+
"total_tokens": 796
45+
}
46+
},
2547
{
2648
"model": "qwen2.5vl:7b",
2749
"temperature": 0.3,

annotations/nsd/shared0005_nsd03147_annotations.json

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,28 @@
2222
}
2323
},
2424
"annotations": [
25+
{
26+
"model": "claude-opus-4-8",
27+
"temperature": 1.0,
28+
"prompts": {
29+
"vision_neuro": {
30+
"prompt_text": "You are describing a photograph for a neuroscience visual-perception study. Analyze the visual elements and their spatial locations: state which are in the foreground vs background and their position in the frame (left/center/right, upper/lower). Note any interactions between elements (people, animals, objects, scene). Describe the overall color scheme, lighting, and visual composition. Ground every statement in clearly visible detail; do not infer context you cannot see. Write one continuous paragraph, 150-200 words.",
31+
"response": "The photograph depicts an old church occupying the center and right portions of the frame, with a tall brick tower rising in the upper center-right, topped by a black-faced clock and small vented openings near its peak. The church's roofs are covered in reddish-brown tiles, while the lower walls are rendered in pale white and gray plaster, punctuated by arched windows outlined in red brick on the left-center and a covered timber porch entrance in the center. In the foreground, a light beige gravel path curves from the lower center toward the porch, bordered by green grass that fills the lower portion of the frame. Numerous weathered gray gravestones are scattered across the grass in the lower-left, lower-center, and lower-right, some leaning at angles. A small black object rests on the grass in the lower-right corner. Bare, leafless trees appear in the upper-right background, indicating cool-season conditions. The overall color scheme combines earthy reds, muted whites, grays, and green, under soft, diffuse, overcast lighting that produces minimal shadows. The composition balances the vertical tower against horizontal roof lines and the curving foreground path.",
32+
"response_format": "text",
33+
"response_data": null,
34+
"error": null,
35+
"hed_annotation": "Sensory-event, Visual-presentation, Photograph, (Building, Label/Church, (Center-of, Photograph)), ((Building-part, Label/Tower, Manufactured-material/Brick), Above, (Building, Label/Church)), (Clock-face, Black, (Top-of, (Building-part, Label/Tower))), ((Roof, Red-color, Brown-color), Top-of, (Building, Label/Church)), (Building-part, White, Gray-color), ((Window, Red, (Building-part, Label/Arched)), Left-side-of, (Building, Label/Church)), (Door, (Building-part, Label/Timber-porch), Center-of, (Building, Label/Church)), (Path, Beige, Gravel-terrain, (Lower-center-of, Photograph)), (Grassy-terrain, Green, (Below, Photograph)), (Group-of, Sculpture, Gray-color, Label/Gravestones, (Lower-left-of, Photograph)), (Object, Black, (Lower-right-of, Photograph)), (Group-of, Plant, Label/Bare-trees, (Upper-right-of, Photograph)), (Label/Luminance-contrast-Low, Label/Overcast)",
36+
"token_metrics": {
37+
"input_tokens": 421,
38+
"output_tokens": 365,
39+
"total_tokens": 786
40+
}
41+
}
42+
},
43+
"metrics": {
44+
"total_tokens": 786
45+
}
46+
},
2547
{
2648
"model": "qwen2.5vl:7b",
2749
"temperature": 0.3,

annotations/nsd/shared0006_nsd03158_annotations.json

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -22,6 +22,28 @@
2222
}
2323
},
2424
"annotations": [
25+
{
26+
"model": "claude-opus-4-8",
27+
"temperature": 1.0,
28+
"prompts": {
29+
"vision_neuro": {
30+
"prompt_text": "You are describing a photograph for a neuroscience visual-perception study. Analyze the visual elements and their spatial locations: state which are in the foreground vs background and their position in the frame (left/center/right, upper/lower). Note any interactions between elements (people, animals, objects, scene). Describe the overall color scheme, lighting, and visual composition. Ground every statement in clearly visible detail; do not infer context you cannot see. Write one continuous paragraph, 150-200 words.",
31+
"response": "The photograph centers on a white ceramic bowl filling most of the frame, containing a stir-fried dish shot from a slightly elevated angle. In the foreground, occupying the lower and central portions, are cubed white and browned tofu or radish pieces, alongside irregular clumps of golden-brown fried or crumbled meat and darker cooked greens. Scattered across the top surface, chiefly in the upper-center and upper-right, are bright green sliced scallion rings that provide vivid color contrast against the warmer tones below. Small pale spherical items, possibly quail eggs or garlic cloves, appear in the center and lower-right of the dish. In the upper background, out of focus, the white rim of the bowl curves along with a blurred dark horizontal band and a faint pale object at the top edge, likely a spoon handle or utensil. The overall color scheme is dominated by warm browns, golden oranges, and off-white ceramic, punctuated by the green scallions. Lighting is soft and directional, brightening the upper-left food surfaces while casting subtle shadows in the crevices. The composition is tightly cropped, filling the frame and emphasizing texture, with shallow depth of field.",
32+
"response_format": "text",
33+
"response_data": null,
34+
"error": null,
35+
"hed_annotation": "Sensory-event, Visual-presentation, Photograph, ((Ingestible-object/Main-dish, Savory), (Center-of, (White, Ceramic, Man-made-object/Bowl))), ((Cube, White, Ingestible-object/Main-dish), Lower-center-of), (Brown, Ingestible-object/Main-dish), ((Green, Ingestible-object/Main-dish), Upper-right-of), ((White, Ingestible-object/Main-dish), Lower-right-of), (Background-view, (White, Ceramic, Man-made-object/Bowl)), (Shallow, Depth), Aerial-view",
36+
"token_metrics": {
37+
"input_tokens": 421,
38+
"output_tokens": 391,
39+
"total_tokens": 812
40+
}
41+
}
42+
},
43+
"metrics": {
44+
"total_tokens": 812
45+
}
46+
},
2547
{
2648
"model": "qwen2.5vl:7b",
2749
"temperature": 0.3,

0 commit comments

Comments
 (0)