Human Generated Data

Title

Untitled (four photographs: family portraits outside house)
Date

c. 1940, printed later
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.6802

Human Generated Data

Title

Untitled (four photographs: family portraits outside house)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-18

Advertisement 99.9
Collage 99.9
Poster 99.9
Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 99.6
Person 99.5
Tie 99.4
Accessories 99.4
Accessory 99.4
Person 99.3
Person 99
Person 98
Person 98
Person 97.5
Person 97.3
Person 96.7
Person 95.9
Person 94.6
Clothing 94.4
Apparel 94.4
Person 94.3
Suit 93.2
Coat 93.2
Overcoat 93.2
Person 91
Person 89.4
People 87.1
Face 69.3
Military Uniform 68.4
Military 68.4
Funeral 67.5
Costume 60.7
Sailor Suit 58.7
Team 56.4

Clarifai
created on 2019-11-18

people 99.6
group 98.7
many 97.8
adult 95.6
wear 94.8
outfit 94.4
group together 94.2
man 92.9
offense 92.4
cavalry 91.9
police 91.1
law 91
woman 89.4
street 87.5
military 87.1
administration 85.8
child 84.9
canine 83.4
dog 81.7
vehicle 81.3

Imagga
created on 2019-11-18

hockey stick 25.1
people 22.3
city 21.6
urban 21
stick 20.1
clothing 18.4
man 18.1
person 17.6
passenger 16.8
sports equipment 16.2
black 15.3
street 14.7
motion 14.5
equipment 14.1
transportation 13.4
men 12.9
business 12.7
sport 12.7
silhouette 12.4
male 12.1
fashion 12
covering 11.1
adult 11.1
transport 10.9
walk 10.5
window 10.4
portrait 10.3
helmet 10.3
women 10.3
dress 9.9
travel 9.8
shop 9.8
walking 9.5
blur 9.3
power 9.2
outdoor 9.2
style 8.9
interior 8.8
crowd 8.6
architecture 8.6
consumer goods 8.5
wall 8.5
grunge 8.5
inside 8.3
active 8.1
team 8.1
building 8
life 7.8
move 7.7
old 7.7
sidewalk 7.5
knee pad 7.5
comic book 7.5
group 7.3
sexy 7.2
modern 7

Google
created on 2019-11-18

Photograph 95.9
Black-and-white 74.4
Team 72.7
Photography 70.6
Picture frame 56.2
Collection 54
Art 50.2

Microsoft
created on 2019-11-18

clothing 98.3
text 96
man 95.7
outdoor 90.8
person 90.3
posing 71.2
footwear 66.8
different 65.9
group 65
black and white 60.8
bunch 50.2
step 30.8
same 21.8
several 12.2

Face analysis

Amazon

AWS Rekognition

Age 37-55
Gender Female, 52.7%
Fear 45%
Calm 45%
Surprised 45%
Confused 45%
Disgusted 45.3%
Happy 54.6%
Sad 45%
Angry 45.1%

AWS Rekognition

Age 39-57
Gender Male, 54.5%
Fear 45.1%
Angry 47.6%
Calm 47.1%
Surprised 45.1%
Happy 45.1%
Confused 45.3%
Sad 45.3%
Disgusted 49.4%

AWS Rekognition

Age 46-64
Gender Female, 51.5%
Angry 45.3%
Calm 53.5%
Confused 45.2%
Disgusted 45%
Surprised 45%
Happy 45.6%
Sad 45.4%
Fear 45%

AWS Rekognition

Age 25-39
Gender Male, 54.8%
Sad 45.3%
Calm 53.5%
Angry 45.7%
Fear 45%
Happy 45.1%
Surprised 45.1%
Disgusted 45.1%
Confused 45.2%

AWS Rekognition

Age 41-59
Gender Male, 54.9%
Calm 50.2%
Fear 45%
Confused 45%
Happy 45%
Angry 49.6%
Disgusted 45%
Sad 45.1%
Surprised 45%

AWS Rekognition

Age 57-75
Gender Male, 50.2%
Disgusted 45%
Calm 50.6%
Confused 45.7%
Sad 47.5%
Happy 45.1%
Angry 46.1%
Fear 45%
Surprised 45.1%

AWS Rekognition

Age 36-52
Gender Male, 50.4%
Disgusted 49.6%
Angry 49.6%
Calm 49.5%
Surprised 49.5%
Sad 49.8%
Confused 49.9%
Fear 49.6%
Happy 49.6%

AWS Rekognition

Age 23-37
Gender Male, 50.2%
Angry 49.5%
Sad 49.5%
Confused 49.7%
Disgusted 50.1%
Surprised 49.5%
Happy 49.5%
Fear 49.5%
Calm 49.6%

AWS Rekognition

Age 30-46
Gender Male, 54.7%
Surprised 45%
Calm 52.9%
Fear 45%
Disgusted 45.1%
Happy 45%
Angry 46.2%
Sad 45.2%
Confused 45.5%

AWS Rekognition

Age 24-38
Gender Male, 50.5%
Disgusted 49.5%
Calm 49.8%
Angry 49.6%
Confused 50.1%
Fear 49.5%
Sad 49.5%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 19-31
Gender Male, 50.5%
Disgusted 49.5%
Angry 49.6%
Fear 49.5%
Happy 49.7%
Confused 49.6%
Sad 49.9%
Calm 49.7%
Surprised 49.5%

AWS Rekognition

Age 14-26
Gender Female, 50.5%
Disgusted 49.5%
Happy 50.4%
Surprised 49.5%
Sad 49.5%
Fear 49.5%
Calm 49.5%
Angry 49.5%
Confused 49.5%

AWS Rekognition

Age 25-39
Gender Female, 50.1%
Calm 49.5%
Happy 50.5%
Angry 49.5%
Disgusted 49.5%
Fear 49.5%
Sad 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 41-59
Gender Male, 50.4%
Angry 49.5%
Calm 49.5%
Sad 49.5%
Happy 50.5%
Fear 49.5%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 22-34
Gender Male, 50.1%
Calm 50.1%
Fear 49.5%
Confused 49.6%
Surprised 49.5%
Angry 49.5%
Happy 49.6%
Sad 49.6%
Disgusted 49.6%

AWS Rekognition

Age 37-55
Gender Female, 50.5%
Angry 49.5%
Happy 50.1%
Fear 49.5%
Disgusted 49.5%
Sad 49.5%
Calm 49.9%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 34-50
Gender Female, 50.1%
Fear 49.5%
Disgusted 49.7%
Calm 49.5%
Happy 49.9%
Surprised 49.5%
Angry 49.5%
Sad 49.7%
Confused 49.6%

AWS Rekognition

Age 3-9
Gender Female, 50.1%
Disgusted 49.5%
Angry 49.5%
Confused 49.5%
Calm 49.5%
Sad 50.4%
Happy 49.5%
Surprised 49.5%
Fear 49.5%

AWS Rekognition

Age 33-49
Gender Male, 50.5%
Sad 49.7%
Fear 49.6%
Disgusted 49.8%
Angry 49.5%
Happy 49.6%
Confused 49.7%
Calm 49.7%
Surprised 49.5%

AWS Rekognition

Age 27-43
Gender Male, 50.1%
Disgusted 49.8%
Happy 49.6%
Angry 49.5%
Fear 49.5%
Calm 49.8%
Confused 49.6%
Surprised 49.5%
Sad 49.6%

AWS Rekognition

Age 15-27
Gender Female, 50.5%
Sad 49.5%
Calm 50.3%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.6%
Fear 49.5%

AWS Rekognition

Age 33-49
Gender Female, 54.9%
Surprised 45.1%
Angry 45.2%
Fear 45%
Calm 45.6%
Confused 45.2%
Sad 45.1%
Disgusted 45.4%
Happy 53.5%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Angry 49.5%
Calm 49.5%
Happy 50.3%
Sad 49.5%
Fear 49.5%
Surprised 49.5%
Disgusted 49.7%
Confused 49.5%

AWS Rekognition

Age 6-16
Gender Female, 50.5%
Confused 49.5%
Fear 49.5%
Angry 49.5%
Sad 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 50.4%
Calm 49.5%

AWS Rekognition

Age 21-33
Gender Male, 50.5%
Angry 49.5%
Fear 49.5%
Disgusted 49.5%
Sad 49.5%
Confused 49.5%
Calm 49.5%
Happy 50.5%
Surprised 49.5%

AWS Rekognition

Age 47-65
Gender Female, 50.5%
Confused 49.6%
Calm 49.6%
Surprised 49.5%
Fear 49.5%
Happy 49.9%
Angry 49.5%
Sad 49.5%
Disgusted 49.8%

AWS Rekognition

Age 1-7
Gender Female, 50.1%
Calm 49.5%
Angry 49.8%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 50.1%
Fear 49.5%
Confused 49.5%

AWS Rekognition

Age 3-11
Gender Female, 50.2%
Angry 49.5%
Happy 50.5%
Disgusted 49.5%
Calm 49.5%
Fear 49.5%
Surprised 49.5%
Sad 49.5%
Confused 49.5%

AWS Rekognition

Age 5-15
Gender Female, 50.4%
Surprised 49.5%
Sad 49.6%
Calm 49.6%
Happy 49.9%
Confused 49.6%
Disgusted 49.5%
Fear 49.5%
Angry 49.7%

Feature analysis

Amazon

Person 99.7%
Tie 99.4%

Captions

Microsoft

a group of people posing for a photo 89%
a group of people posing for a picture 88.9%
a group of people posing for the camera 88.8%