Human Generated Data

Title

Untitled (children at birthday party)

Date

1948

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2802

Human Generated Data

Title

Untitled (children at birthday party)

People

Artist: Harry Annas, American 1897 - 1980

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Person 99.7
Human 99.7
Person 99.6
Person 99.6
Person 99.4
Apparel 99.3
Clothing 99.3
Person 98.5
Person 97.9
Person 97.7
Person 96.6
Person 96.3
Dress 94.2
Person 89.7
Female 88.5
Person 87.6
Shoe 86.1
Footwear 86.1
Furniture 84.7
Person 84.3
Shoe 84.1
Person 83.5
People 83.1
Shorts 81.4
Skirt 80.9
Indoors 80.8
Room 80.3
Shoe 77
Kid 73.9
Child 73.9
Girl 73.5
Face 69.6
Shoe 67.3
Suit 66.8
Overcoat 66.8
Coat 66.8
Portrait 64.6
Photography 64.6
Photo 64.6
Woman 60.9
Person 59.1
Costume 58.8
Kindergarten 57.5
Chair 57.3
Living Room 57
Cabinet 56.6
Floor 55.3
Person 52.3

Imagga
created on 2022-01-16

brass 86.1
wind instrument 64.9
musical instrument 45.7
people 29.5
baritone 23.9
trombone 21.1
men 19.7
man 19.5
adult 18
person 17.6
group 16.9
pedestrian 14.6
happy 14.4
team 14.3
women 13.4
male 12.8
city 12.5
human 12
travel 12
business 11.5
crowd 11.5
holiday 11.5
fashion 11.3
urban 10.5
portrait 10.3
silhouette 9.9
sport 9.9
professional 9.6
celebration 9.6
walking 9.5
happiness 9.4
suit 9
world 8.9
music 8.9
cornet 8.7
couple 8.7
girls 8.2
dress 8.1
active 8.1
businessman 7.9
together 7.9
smile 7.8
boy 7.8
clothing 7.8
motion 7.7
war 7.7
attractive 7.7
performer 7.6
friends 7.5
fun 7.5
holding 7.4
street 7.4
bugle 7.3
present 7.3
tourist 7.2
celebrate 7.2
work 7.1
day 7.1
teacher 7
musician 7

Microsoft
created on 2022-01-16

text 97.2
christmas tree 95.8
clothing 81.6
footwear 75.8
person 75.4
posing 44.2

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 98.5%
Calm 88.5%
Surprised 8.2%
Happy 1.6%
Sad 0.5%
Angry 0.5%
Confused 0.3%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 30-40
Gender Male, 90.9%
Surprised 70%
Fear 16.3%
Calm 11.1%
Sad 0.7%
Angry 0.6%
Confused 0.6%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Male, 98.2%
Surprised 45.9%
Calm 23.2%
Happy 21.5%
Angry 2.6%
Fear 2.5%
Sad 1.8%
Confused 1.4%
Disgusted 1.2%

AWS Rekognition

Age 27-37
Gender Male, 79.5%
Calm 90.4%
Angry 4.8%
Happy 1.7%
Confused 0.8%
Sad 0.8%
Fear 0.5%
Disgusted 0.5%
Surprised 0.4%

AWS Rekognition

Age 19-27
Gender Male, 98.7%
Calm 82.3%
Surprised 10.8%
Angry 2.3%
Sad 1.6%
Confused 1.4%
Fear 0.7%
Disgusted 0.7%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 79.7%
Sad 88.5%
Calm 6.8%
Happy 1.4%
Surprised 1.2%
Disgusted 0.9%
Angry 0.7%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 30-40
Gender Female, 91%
Calm 56.9%
Surprised 26.8%
Sad 14.1%
Angry 0.8%
Fear 0.6%
Disgusted 0.4%
Confused 0.2%
Happy 0.1%

AWS Rekognition

Age 38-46
Gender Female, 63.6%
Happy 59.8%
Sad 18.4%
Calm 14.1%
Confused 3.5%
Surprised 1.8%
Angry 1%
Fear 0.9%
Disgusted 0.5%

AWS Rekognition

Age 27-37
Gender Male, 97.1%
Calm 98.5%
Surprised 0.5%
Sad 0.4%
Angry 0.2%
Confused 0.2%
Happy 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 18-26
Gender Male, 97.6%
Calm 40.8%
Sad 26%
Fear 18.1%
Surprised 8.7%
Angry 2.2%
Confused 1.5%
Disgusted 1.4%
Happy 1.3%

AWS Rekognition

Age 42-50
Gender Female, 97.4%
Sad 60.7%
Calm 36.7%
Happy 0.8%
Confused 0.5%
Angry 0.4%
Disgusted 0.3%
Surprised 0.3%
Fear 0.3%

AWS Rekognition

Age 14-22
Gender Male, 82%
Calm 98.9%
Sad 0.6%
Surprised 0.3%
Fear 0.1%
Disgusted 0%
Angry 0%
Confused 0%
Happy 0%

AWS Rekognition

Age 18-24
Gender Male, 99.8%
Calm 63.2%
Surprised 26.7%
Happy 2.8%
Sad 2.4%
Angry 1.6%
Confused 1.3%
Fear 1%
Disgusted 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 86.1%

Captions

Microsoft

a group of people standing in front of a window 59.7%
a group of people standing in front of a store 54.5%
a group of people posing for a photo 54.4%

Text analysis

Amazon

11
KODAK-EVEELA

Google

YT3RA2-XAGOX
YT3RA2-XAGOX