Human Generated Data

Title

The Felsenfeld/Gold Families, Philadelphia

Date

2007

People

Artist: Thomas Struth, German born 1954

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Friends Anniversary Collection, Gift of the artist, 2011.23

Human Generated Data

Title

The Felsenfeld/Gold Families, Philadelphia

People

Artist: Thomas Struth, German born 1954

Date

2007

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Friends Anniversary Collection, Gift of the artist, 2011.23

Machine Generated Data

Tags

Amazon
created on 2019-04-06

Clothing 99.7
Footwear 99.7
Apparel 99.7
Human 99.4
Furniture 82.4
Sitting 70.7
People 68.3
Diagram 66.7
Plot 57.1
Map 56.1

Clarifai
created on 2018-03-23

woman 98.8
people 98.8
group 98.4
adult 98
man 96.9
room 93.5
family 91.3
business 90.2
child 88.7
wear 86.6
recreation 86.3
girl 85.7
meeting 84.5
group together 83.9
lifestyle 81.8
class 80.4
education 79.4
portrait 77.8
indoors 77
boy 76.3

Imagga
created on 2018-03-23

kin 42
child 37.7
people 34
man 30.9
person 30
happy 28.2
male 27.8
group 27.4
school 23.9
teacher 23.6
education 23.4
classroom 22.6
student 22.1
smile 21.4
smiling 21
world 19.4
adult 19.4
women 19
men 18.9
family 18.7
boy 18.2
businessman 17.6
buddy 17.6
happiness 16.4
business 15.8
trainer 15.6
team 15.2
professional 14.8
class 14.5
kid 14.2
blackboard 13.8
children 13.7
mother 13.6
map 13.5
childhood 13.4
color 13.3
cheerful 13
room 12.7
portrait 12.3
lifestyle 12.3
friends 12.2
couple 12.2
casual 11.9
holding 11.5
together 11.4
fun 11.2
father 11.2
sitting 11.2
teamwork 11.1
board 10.8
lesson 10.7
success 10.5
standing 10.4
looking 10.4
study 10.3
suit 9.9
youth 9.4
life 9.2
teen 9.2
joy 9.2
indoor 9.1
businesswoman 9.1
home 8.8
students 8.8
studying 8.6
drawing 8.6
daughter 8.6
desk 8.5
learning 8.4
black 8.4
communication 8.4
human 8.2
teenager 8.2
little 7.9
indoors 7.9
love 7.9
work 7.8
elementary 7.8
pupil 7.8
corporate 7.7
diversity 7.7
expression 7.7
reading 7.6
hand 7.6
college 7.6
sit 7.6
friendship 7.5
friendly 7.3
girls 7.3
handsome 7.1
job 7.1
son 7

Google
created on 2018-03-23

blue 96.8
social group 94.8
fun 69.3
girl 52.6

Microsoft
created on 2018-03-23

person 99.7
scene 93.8
room 92
gallery 88.7
people 75.9
group 71
posing 68.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

Imagga

AWS Rekognition

Age 45-66
Gender Male, 54.4%
Happy 45.9%
Surprised 45.2%
Calm 50.1%
Confused 46.1%
Sad 46.3%
Angry 46%
Disgusted 45.3%

AWS Rekognition

Age 48-68
Gender Female, 50.1%
Happy 48.3%
Sad 45.6%
Disgusted 45.5%
Calm 49.8%
Angry 45.4%
Surprised 45.1%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 55%
Sad 45%
Surprised 45.1%
Angry 45.1%
Happy 54.3%
Calm 45%
Confused 45%
Disgusted 45.4%

AWS Rekognition

Age 45-65
Gender Male, 54.9%
Happy 45.6%
Disgusted 45.1%
Confused 45.5%
Sad 45.4%
Angry 45.3%
Surprised 45.2%
Calm 52.9%

AWS Rekognition

Age 26-43
Gender Female, 55%
Surprised 45.4%
Confused 45.3%
Sad 45.2%
Calm 45.2%
Angry 45.3%
Happy 53.5%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Male, 55%
Confused 45%
Calm 54.8%
Disgusted 45%
Angry 45%
Happy 45%
Sad 45.1%
Surprised 45%

AWS Rekognition

Age 9-14
Gender Female, 54.9%
Sad 46.2%
Calm 49.6%
Angry 45.4%
Confused 45.4%
Disgusted 45.1%
Happy 47.7%
Surprised 45.7%

AWS Rekognition

Age 38-57
Gender Female, 54.9%
Happy 54.9%
Disgusted 45%
Calm 45%
Sad 45.1%
Angry 45%
Confused 45%
Surprised 45%

AWS Rekognition

Age 10-15
Gender Female, 54.9%
Confused 45%
Calm 45.4%
Disgusted 45%
Angry 45.1%
Happy 51.3%
Sad 48%
Surprised 45.1%

AWS Rekognition

Age 26-43
Gender Female, 54.2%
Surprised 45.2%
Confused 45.5%
Sad 47.8%
Calm 50.6%
Angry 45.6%
Happy 45.1%
Disgusted 45.1%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 28
Gender Male

Microsoft Cognitive Services

Age 39
Gender Female

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 42
Gender Female

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 7
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Imagga

Traits no traits identified

Feature analysis

Amazon

Shoe
Person
Couch

Clarifai

Footwear
Man
Human face
Woman
Jeans
Human hair
Human arm
Human leg
Human hand
Person

AWS Rekognition

Shoe 99.7%

AWS Rekognition

Shoe 83.1%

AWS Rekognition

Shoe 75.7%

AWS Rekognition

Shoe 62.7%

AWS Rekognition

Shoe 61.9%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.4%

AWS Rekognition

Person 99.2%

AWS Rekognition

Person 98.6%

AWS Rekognition

Person 97.3%

AWS Rekognition

Person 95.6%

AWS Rekognition

Person 93.5%

AWS Rekognition

Person 91%

AWS Rekognition

Person 80.5%

AWS Rekognition

Couch 82.4%

Clarifai

Footwear 97.8%

Clarifai

Footwear 88.6%

Clarifai

Footwear 88.5%

Clarifai

Footwear 87.4%

Clarifai

Footwear 87.1%

Clarifai

Footwear 84.4%

Clarifai

Footwear 82.1%

Clarifai

Footwear 78.2%

Clarifai

Footwear 77.8%

Clarifai

Footwear 73.7%

Clarifai

Footwear 65.3%

Clarifai

Footwear 60.3%

Clarifai

Footwear 56.2%

Clarifai

Footwear 55.1%

Clarifai

Footwear 43.6%

Clarifai

Footwear 41.1%

Clarifai

Footwear 37.7%

Clarifai

Footwear 37%

Clarifai

Footwear 35.6%

Clarifai

Footwear 34.6%

Clarifai

Footwear 34%

Clarifai

Footwear 33.3%

Clarifai

Footwear 33.3%

Clarifai

Man 85.2%

Clarifai

Man 79.4%

Clarifai

Man 72.2%

Clarifai

Man 60.2%

Clarifai

Man 41%

Clarifai

Human face 73.3%

Clarifai

Human face 69.5%

Clarifai

Human face 66.2%

Clarifai

Human face 66.1%

Clarifai

Human face 64.2%

Clarifai

Human face 63.4%

Clarifai

Human face 61.8%

Clarifai

Human face 59.9%

Clarifai

Human face 58.4%

Clarifai

Human face 57.4%

Clarifai

Woman 65.3%

Clarifai

Woman 63.3%

Clarifai

Woman 62.8%

Clarifai

Woman 62.4%

Clarifai

Woman 61.1%

Clarifai

Woman 47.5%

Clarifai

Jeans 50.3%

Clarifai

Human hair 49.3%

Clarifai

Human hair 36.7%

Clarifai

Human arm 47.4%

Clarifai

Human arm 36.6%

Clarifai

Human arm 35.2%

Clarifai

Human arm 34.4%

Clarifai

Human arm 33.1%

Clarifai

Human leg 36.5%

Clarifai

Human leg 35%

Clarifai

Human hand 36.3%

Clarifai

Person 34.9%

Categories

Captions

Clarifai

No captions written

Salesforce

Created by general-english-image-caption-blip-2 on 2025-06-27

a group of people sitting on couches in front of a map

Created by general-english-image-caption-blip on 2025-05-04

a photograph of a group of people sitting on couches in a room

OpenAI GPT

Created by gpt-4o-2024-08-06 on 2025-05-15

The image shows a group of people gathered in a room. They are sitting and standing around a collection of couches with a world map prominently displayed on the wall behind them. The couches are a mix of muted purple and red colors, complementing the light blue floor. The group appears relaxed and casually posed, suggesting a social or informal setting. The map shows detailed geographical features of the continents and oceans, providing a vivid backdrop to the scene. Additionally, some personal items like shoes are visible on the floor nearby.

Created by gpt-4o-2024-11-20 on 2025-05-15

The image showcases a group of people seated in a living area with a large, detailed world map on the wall behind them. The seating consists of couches in muted purple and red tones placed on a light blue wooden floor. One person is sitting casually on the ground, while others are seated or standing, creating a relaxed atmosphere. The arrangement suggests a gathering, with a mix of formal and casual clothing visible among the individuals. The prominent world map adds a global or educational context to the setting.

Anthropic Claude

Created by us.anthropic.claude-3-5-sonnet-20241022-v2:0 on 2025-06-24

This image shows a group of people gathered in what appears to be a room with a large world map on the wall behind them. The room has a blue floor and features several brown/purple velvet couches and a red velvet chair where the group is seated and arranged. The world map is prominently displayed and appears to be a detailed physical/topographical map with blue oceans and green/beige landmasses. The group appears to be in a casual, relaxed setting, with some sitting on the couches and others standing. The composition has a family or group portrait feel to it, with the world map serving as an interesting backdrop that dominates the upper portion of the image.

Created by claude-3-haiku-20240307 on 2024-12-30

The image shows a group portrait of several people sitting on sofas and chairs in a room with a large world map displayed on the wall behind them. The group includes individuals of varying ages, from older adults to younger adults and children. They appear to be a family or group of acquaintances gathered together, possibly in a professional or organizational setting given the presence of the world map. The overall impression is of a cohesive and connected group of people in a comfortable, informal setting.

Created by claude-3-opus-20240229 on 2024-12-30

The image shows a diverse group of people, likely a family spanning multiple generations, posing together on couches in front of a large world map mural. The map depicts the continents and oceans in shades of blue and green. The group includes older adults, middle-aged couples, and several children of varying ages. They are casually dressed and appear relaxed, with some smiling at the camera. The room has wood flooring and maroon velvet couches, giving it a cozy, homey feel perfect for a family gathering or portrait.

Created by claude-3-5-sonnet-20241022 on 2024-12-30

This image shows a group of people seated in what appears to be a room with a large world map on the wall behind them. The room has a casual, comfortable setting with brown and burgundy colored couches and chairs. There are several adults and children arranged in an informal group pose. The floor appears to be painted blue, and the wall with the map features vibrant turquoise oceans and green/beige continents. The atmosphere seems relaxed and familial, with everyone dressed casually. The world map serves as an striking backdrop and focal point for the photograph.

Meta Llama

Created by us.meta.llama3-2-11b-instruct-v1:0 on 2025-05-15

The image depicts a family of ten individuals, comprising two adults and eight children, posing for a photograph in a living room setting. The family is arranged in a semi-circle, with the adults seated on the floor and the children on couches.

The adults are dressed in casual attire, with the man on the left wearing a gray sweater and khaki pants, while the woman beside him is wearing a black-and-white striped shirt and blue pants. The man on the right is wearing a dark blue shirt with white polka dots and black pants, accompanied by a woman in a floral top and white pants.

The children are also dressed in casual clothing, with some wearing dresses or skirts and others wearing pants and shirts. One child is sitting on the floor, while the others are seated on the couches.

In the background, a large world map hangs on the wall, providing a sense of global context to the scene. The map is blue and green, with various countries and continents visible. The floor is made of light blue wood, adding a touch of warmth to the space.

Overall, the image presents a heartwarming and intimate portrayal of a family, capturing a moment of togetherness and connection.

Created by us.meta.llama3-2-90b-instruct-v1:0 on 2025-05-15

This image depicts a family of eleven individuals posing for a photograph in front of a large map of the world. The family is arranged in two rows, with the back row standing and the front row seated on couches.

The family members are dressed in casual attire, with some wearing dark-colored clothing and others sporting lighter shades. The background features a large map of the world, which serves as a striking backdrop for the family portrait. The overall atmosphere of the image exudes warmth and togetherness, capturing a special moment in time for this close-knit family.

Amazon Nova

Created by amazon.nova-pro-v1:0 on 2025-05-15

In a room, a group of people are sitting on couches, and some are standing while posing for a photograph. A person on the left is sitting on the floor, and a person beside him is wearing glasses. A world map is mounted on the wall behind them. Some papers are pasted on the map. Some footwear is placed on the floor in front of the couch.

Created by amazon.nova-lite-v1:0 on 2025-05-15

The image features a family portrait taken in a room with a world map on the wall. The family members are sitting on couches, with some standing behind them. The family consists of several people, including adults and children. The adults are dressed in casual clothing, and the children are wearing dresses and blouses. The family is posing for a photo, and they are all smiling. The room has a simple and minimalistic design, with a blue floor and white walls.

Google Gemini

Created by gemini-2.0-flash-lite on 2025-05-03

Here's a description of the image:

Overall Scene:

The image is a group portrait of a family, staged indoors against a plain white wall. The composition is centered around a large, vibrant map of the world that dominates the background.

People:

  • There are eleven people of varying ages in the image, suggesting a multi-generational family.
  • They are arranged in a somewhat informal manner, some sitting on the floor, some in low-profile purple velvet armchairs, and others standing.
  • The expressions on the faces range from serious to neutral.
  • The clothing styles are casual, with a range of colors and patterns.

Setting and Composition:

  • The background features a large world map, possibly a vintage or educational map.
  • The floor is painted a light blue.
  • The furniture is minimalist in style.
  • The lighting appears to be natural, contributing to the brightness and clarity of the photograph.

Atmosphere:

The image has a classic, slightly formal feel due to the group portrait setup. The map in the background adds a sense of wanderlust and perhaps the theme of family travel or heritage. The scene feels authentic.

Created by gemini-2.0-flash on 2025-05-03

Here's a description of the image:

A large group of ten people are gathered indoors for a group portrait. They are seated on or around three different couches - two purple couches and one red couch. An older couple stands against a white wall. The man is wearing a blue shirt and the woman is wearing a floral-patterned shirt. The other eight individuals are seated or leaning against the couches. The couches are arranged as though they are angled in a circle facing the camera. There are 2 women seated on each of the purple couches and 2 women seated on the red couch. On the first purple couch there is a bald man seated on the floor with his back against the couch. Beside him is a woman seated on the couch with her arm on his shoulder. On the second purple couch is a man wearing glasses sitting. A young girl is standing behind the couch with her hands on his shoulders. Next to the purple couch there is a woman seated on the couch with a young girl in her lap. On the red couch there is a woman seated with a man behind the couch. There are pairs of shoes on the floor near the red couch.

Behind them, a giant world map covers most of the wall. The map is predominantly blue, representing the oceans, with detailed landmasses in shades of green and brown. A poster, likely indicating directions on "THE WORLD" can be seen on the map. The floor in the room is painted a light blue.

Mistral Pixtral

Created by us.mistral.pixtral-large-2502-v1:0 on 2025-05-15

The image depicts a group of ten people posing for a photograph in an indoor setting. The background features a large map of the world, which is prominently displayed on the wall. The map covers a significant portion of the wall and is detailed with various geographical features.

The group is arranged in two rows. In the front row, there are five people sitting on two couches. The couch on the left is brown, and the one on the right is red. The individuals in the front row are casually seated, with some leaning back comfortably.

In the back row, there are five people standing behind the seated individuals. They are positioned in front of the world map, with some leaning slightly against the wall. The people in the group appear to be of different ages and are dressed in casual attire.

The floor of the room is painted blue, and the overall atmosphere of the image is relaxed and informal. The lighting is even, suggesting that the photo was taken in a well-lit room. The group seems to be posing for a family or group portrait, with a mix of expressions ranging from smiles to more neutral looks.

Qwen

No captions written

Text analysis

Amazon

THE
THE WORLD
WORLD

Google

THE WORLD
THE
WORLD