Human Generated Data

Title

Untitled (informal large group portrait outdoors with violinist at right)

Date

c. 1905-1915

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3944

Human Generated Data

Title

Untitled (informal large group portrait outdoors with violinist at right)

People

Artist: Durette Studio, American 20th century

Date

c. 1905-1915

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Apparel 97.7
Clothing 97.7
Human 97.1
Person 97.1
Person 97
Person 96.2
Person 95.6
Person 92.7
Outdoors 92.5
Person 91.2
Water 90.8
Shorts 90.6
Person 89.7
Nature 87.2
Person 87.1
Plant 86.7
Grass 86.7
Dress 83.1
People 82
Person 81.9
Person 79.7
Person 77.7
Person 76.4
Crowd 76
Ocean 71.3
Sea 71.3
Person 71.1
Person 70.4
Yard 70.3
Person 69.9
Female 67.4
Person 67.1
Person 67
Coat 66.2
Suit 66.2
Overcoat 66.2
Sand 64.4
Person 64.2
Person 62.7
Child 62
Kid 62
Swimwear 61.1
Person 61.1
Fashion 59.5
Robe 59.5
Pool 58.6
Girl 58.2
Coast 57.6
Shoreline 57.6
Furniture 56.9
Gown 56.5
Wedding 56.5
Swimming 55.9
Sport 55.9
Sports 55.9
Play 55.6
Lawn 55.4
Park 55.4

Clarifai
created on 2019-06-01

people 99.9
many 99.5
group 98.4
group together 98
crowd 96.1
man 94.7
child 94.3
adult 93.8
recreation 88.5
wear 83.6
music 78.1
woman 76.5
dancing 73.6
spectator 72
education 71.8
art 71.6
leader 69.5
musician 67.9
military 67.5
school 67.3

Imagga
created on 2019-06-01

stage 27.6
structure 22.4
fountain 19.5
platform 18.4
silhouette 18.2
sky 17.9
picket fence 17.6
cemetery 17.5
travel 16.9
landscape 16.4
crowd 16.3
group 16.1
park 15.6
people 15.6
snow 15.1
scene 14.7
outdoor 13.8
fence 13.7
winter 13.6
light 13.4
water 13.3
men 12.9
negative 12.6
black 12.6
man 12.2
old 11.8
stone 11.8
sea 11.7
scenery 11.7
city 11.6
sand 11.6
summer 11.6
tourism 11.5
walking 11.4
rock 11.3
sun 11.3
film 11.1
ice 11
night 10.7
barrier 10.5
beach 10.1
dark 10
tree 10
dirty 9.9
male 9.9
environment 9.9
vacation 9.8
cool 9.8
outdoors 9.7
forest 9.6
cold 9.5
world 9.4
season 9.4
art 9.3
spectator 9.2
lake 9.2
texture 9
person 8.8
women 8.7
grunge 8.5
ocean 8.3
vintage 8.3
trees 8
holiday 7.9
urban 7.9
couple 7.8
party 7.7
fog 7.7
motion 7.7
walk 7.6
smoke 7.4
design 7.3
industrial 7.3
music 7.2
sunset 7.2
photographic paper 7.1
architecture 7
obstruction 7
scenic 7

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

outdoor 97.6
person 79.7
people 76.8
black 69.1
white 69
group 64.9
clothing 59.7
team 55.7
old 52
crowd 27

Face analysis

Amazon

AWS Rekognition

Age 30-47
Gender Female, 53.6%
Sad 46.1%
Happy 46.3%
Surprised 45.3%
Calm 45.7%
Disgusted 49.9%
Confused 45.2%
Angry 46.4%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Disgusted 49.5%
Happy 49.5%
Surprised 49.6%
Sad 49.8%
Angry 49.6%
Confused 49.7%
Calm 49.7%

AWS Rekognition

Age 26-43
Gender Female, 54.1%
Surprised 45.2%
Disgusted 45.1%
Calm 51.3%
Happy 45.2%
Sad 47.8%
Angry 45.2%
Confused 45.2%

AWS Rekognition

Age 35-52
Gender Female, 53.6%
Disgusted 46.6%
Angry 50.9%
Confused 45.2%
Sad 45.9%
Happy 45.7%
Calm 45.1%
Surprised 45.5%

AWS Rekognition

Age 26-43
Gender Male, 50%
Angry 49.6%
Happy 49.6%
Confused 49.6%
Calm 49.9%
Surprised 49.6%
Sad 49.7%
Disgusted 49.6%

AWS Rekognition

Age 23-38
Gender Female, 53.5%
Angry 45.6%
Happy 48.4%
Confused 45.4%
Sad 48%
Calm 46.9%
Surprised 45.4%
Disgusted 45.3%

AWS Rekognition

Age 26-43
Gender Female, 53.2%
Confused 46%
Happy 45%
Surprised 45.2%
Angry 46%
Disgusted 45.2%
Calm 45.9%
Sad 51.6%

AWS Rekognition

Age 23-38
Gender Female, 53.9%
Angry 45.2%
Calm 53%
Sad 45.4%
Surprised 45.3%
Disgusted 45.4%
Happy 45.5%
Confused 45.2%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Surprised 49.5%
Calm 49.5%
Disgusted 50.2%
Confused 49.5%
Sad 49.5%
Happy 49.6%
Angry 49.6%

AWS Rekognition

Age 29-45
Gender Female, 50.4%
Sad 49.6%
Happy 49.8%
Surprised 49.6%
Calm 49.8%
Disgusted 49.6%
Confused 49.5%
Angry 49.6%

AWS Rekognition

Age 30-47
Gender Female, 50.4%
Happy 49.6%
Confused 49.5%
Disgusted 49.9%
Sad 49.7%
Calm 49.6%
Angry 49.6%
Surprised 49.6%

AWS Rekognition

Age 19-36
Gender Female, 50.3%
Happy 49.8%
Disgusted 49.5%
Angry 49.6%
Calm 49.6%
Surprised 49.6%
Confused 49.6%
Sad 49.7%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Disgusted 49.7%
Calm 49.7%
Surprised 49.6%
Angry 49.6%
Happy 49.7%
Sad 49.8%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 53.3%
Angry 46.1%
Happy 46.4%
Confused 45.5%
Calm 45.7%
Surprised 45.5%
Sad 45.4%
Disgusted 50.4%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Disgusted 49.5%
Calm 49.7%
Confused 49.5%
Sad 49.7%
Surprised 49.5%
Angry 49.6%
Happy 49.9%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Sad 49.8%
Angry 49.6%
Happy 49.7%
Confused 49.6%
Calm 49.8%
Surprised 49.6%
Disgusted 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Disgusted 49.5%
Calm 50%
Confused 49.6%
Sad 49.6%
Surprised 49.5%
Angry 49.5%
Happy 49.7%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Angry 49.6%
Sad 49.8%
Surprised 49.5%
Happy 49.6%
Calm 49.9%
Disgusted 49.6%
Confused 49.5%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Happy 49.5%
Angry 49.6%
Surprised 49.6%
Disgusted 49.6%
Sad 49.9%
Calm 49.8%
Confused 49.6%

AWS Rekognition

Age 23-38
Gender Female, 50.1%
Surprised 49.5%
Calm 49.9%
Disgusted 49.6%
Confused 49.6%
Sad 49.8%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Sad 49.2%
Angry 45.7%
Happy 45.1%
Confused 45.6%
Calm 48.9%
Surprised 45.3%
Disgusted 45.2%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Happy 49.5%
Sad 50.1%
Confused 49.6%
Angry 49.5%
Disgusted 49.6%
Surprised 49.5%
Calm 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Angry 49.6%
Surprised 49.6%
Disgusted 49.5%
Sad 50.2%
Calm 49.6%
Happy 49.5%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Male, 50.4%
Confused 49.6%
Surprised 49.5%
Happy 49.5%
Calm 49.7%
Sad 50%
Disgusted 49.5%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 54.6%
Angry 46%
Surprised 45.8%
Disgusted 46.7%
Sad 49.4%
Calm 45.7%
Happy 46%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Disgusted 49.7%
Calm 49.7%
Angry 49.6%
Sad 49.8%
Happy 49.6%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.6%
Sad 49.6%
Happy 49.8%
Calm 49.7%
Confused 49.5%
Disgusted 49.7%
Surprised 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.1%
Angry 49.6%
Sad 50.1%
Disgusted 49.5%
Happy 49.6%
Calm 49.6%
Surprised 49.6%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Disgusted 49.8%
Sad 49.6%
Happy 49.7%
Surprised 49.6%
Calm 49.6%
Angry 49.6%
Confused 49.6%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Calm 49.9%
Disgusted 49.5%
Confused 49.6%
Surprised 49.7%
Happy 49.5%
Sad 49.6%
Angry 49.6%

AWS Rekognition

Age 4-9
Gender Female, 50.5%
Disgusted 49.5%
Sad 49.9%
Happy 49.6%
Confused 49.5%
Surprised 49.5%
Angry 49.5%
Calm 49.9%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Surprised 49.5%
Disgusted 49.7%
Calm 49.8%
Happy 49.6%
Sad 49.8%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 53%
Happy 46.1%
Sad 50.4%
Surprised 45.5%
Confused 45.3%
Disgusted 45.7%
Calm 45.8%
Angry 46.2%

AWS Rekognition

Age 15-25
Gender Female, 52%
Happy 45.1%
Surprised 45.2%
Calm 45.4%
Sad 52.7%
Disgusted 46.1%
Angry 45.3%
Confused 45.2%

AWS Rekognition

Age 23-38
Gender Female, 50.3%
Confused 49.6%
Surprised 49.5%
Angry 49.5%
Calm 50.3%
Disgusted 49.5%
Sad 49.6%
Happy 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Disgusted 49.5%
Sad 49.7%
Happy 49.6%
Confused 49.6%
Surprised 49.7%
Angry 49.5%
Calm 49.9%

AWS Rekognition

Age 26-43
Gender Female, 50.2%
Sad 49.6%
Confused 49.6%
Disgusted 49.6%
Surprised 49.6%
Angry 49.6%
Happy 49.8%
Calm 49.7%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Disgusted 49.6%
Sad 49.7%
Calm 49.8%
Confused 49.6%
Surprised 49.6%
Happy 49.8%
Angry 49.6%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Disgusted 49.8%
Confused 49.5%
Sad 49.6%
Happy 49.6%
Angry 49.7%
Surprised 49.6%
Calm 49.7%

AWS Rekognition

Age 35-53
Gender Male, 50.6%
Happy 46.7%
Surprised 45.4%
Angry 47.2%
Confused 45.4%
Calm 45.2%
Sad 45.7%
Disgusted 49.3%

AWS Rekognition

Age 20-38
Gender Female, 50.5%
Angry 49.6%
Happy 49.6%
Confused 49.5%
Calm 50%
Surprised 49.5%
Sad 49.6%
Disgusted 49.6%

Feature analysis

Amazon

Person 97.1%

Captions

Microsoft

a group of people riding on the back of a horse 86.9%
a black and white photo of a group of people in a field 86.8%
a group of people in a field 86.7%

Text analysis

Amazon

Sen