Human Generated Data

Title

Untitled (portrait of a large family)
Date

c. 1950
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2688

Human Generated Data

Title

Untitled (portrait of a large family)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-16

Apparel 99.9
Clothing 99.9
Person 99.8
Human 99.8
Dress 99.8
Person 99.3
Person 99
Shorts 98.3
Person 98.3
Person 97.9
Female 97.5
Person 97
Person 95.9
Person 92.4
Person 91.1
Person 90.6
Person 89.2
Coat 88.3
Suit 88.3
Overcoat 88.3
Woman 86.7
Person 84.3
Person 80.7
Face 80.4
Girl 76.7
People 75.2
Person 74.9
Kid 73.7
Child 73.7
Person 69.8
Costume 68
Skirt 63
Photography 62.7
Photo 62.7
Poster 59.1
Advertisement 59.1
Plant 56.9
Person 56.6
Tuxedo 55.9

Imagga
created on 2022-01-16

dancer 54.9
performer 43.6
person 39.8
people 30.1
entertainer 29.4
brass 28.3
dance 25.1
silhouette 22.3
crowd 22.1
wind instrument 21.9
black 19.9
male 18.4
body 18.4
man 18.3
group 17.7
sexy 16.8
art 16.3
adult 15.9
design 15.7
team 15.2
businessman 15
human 15
musical instrument 14.7
fashion 14.3
lights 13.9
teamwork 13.9
nighttime 13.7
stadium 13.6
vibrant 13.1
business 12.7
cheering 12.7
audience 12.7
patriotic 12.5
nation 12.3
bright 12.1
cornet 12.1
bugle 12.1
men 12
motion 12
flag 11.9
businesswoman 11.8
fitness 11.7
dress 11.7
job 11.5
happy 11.3
attractive 11.2
vivid 11.1
work 11
active 10.8
symbol 10.8
light 10.7
leader 10.6
dancing 10.6
boss 10.5
icon 10.3
women 10.3
presentation 10.2
model 10.1
occupation 10.1
exercise 10
player 9.9
president 9.8
modern 9.8
bride 9.7
anatomy 9.7
style 9.6
performance 9.6
sport 9.5
pretty 9.1
portrait 9.1
health 9
supporters 8.9
science 8.9
medical 8.8
speech 8.8
graphic 8.7
groom 8.7
happiness 8.6
party 8.6
music 8.2
creation 8
couple 7.8
standing 7.8
hip 7.8
band 7.8
concert 7.8
negative 7.6
casual 7.6
studio 7.6
biology 7.6
elegance 7.5
golfer 7.5
athlete 7.2
activity 7.2

Google
created on 2022-01-16

Black 89.7
Dress 84
Font 81.1
Team sport 75.2
Crew 72.6
Sports uniform 72.5
Event 70.4
Uniform 70.2
Vintage clothing 69.8
Room 67.7
Monochrome 67.6
Team 64.2
Monochrome photography 61.2
Player 56.4
Child 56
Photo caption 55.2

Microsoft
created on 2022-01-16

clothing 92.6
person 92.6
text 91.5
posing 88.6
player 66.8
female 36.7

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 98.6%
Calm 62.6%
Sad 24.7%
Surprised 3.5%
Happy 3.4%
Disgusted 3.3%
Angry 1.1%
Confused 0.8%
Fear 0.6%

AWS Rekognition

Age 27-37
Gender Male, 83.9%
Happy 76.7%
Calm 13.9%
Surprised 6.2%
Fear 1.5%
Disgusted 0.6%
Confused 0.5%
Sad 0.4%
Angry 0.2%

AWS Rekognition

Age 36-44
Gender Male, 97.6%
Happy 92.7%
Calm 6.3%
Sad 0.3%
Surprised 0.3%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 31-41
Gender Male, 87.1%
Sad 84.5%
Calm 11.1%
Surprised 1.7%
Confused 0.8%
Fear 0.7%
Disgusted 0.5%
Happy 0.4%
Angry 0.3%

AWS Rekognition

Age 39-47
Gender Female, 56.5%
Calm 97.4%
Sad 1.4%
Happy 0.7%
Surprised 0.2%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Female, 91.4%
Sad 74.9%
Happy 17.5%
Calm 4.4%
Surprised 1.4%
Confused 0.6%
Angry 0.4%
Fear 0.4%
Disgusted 0.4%

AWS Rekognition

Age 30-40
Gender Male, 99.7%
Calm 99.4%
Sad 0.3%
Confused 0.1%
Surprised 0%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Calm 69.7%
Happy 19.9%
Disgusted 4.2%
Surprised 2.5%
Confused 2.5%
Angry 0.6%
Sad 0.4%
Fear 0.3%

AWS Rekognition

Age 27-37
Gender Male, 98.9%
Happy 55.8%
Calm 39.2%
Surprised 3.8%
Confused 0.4%
Disgusted 0.3%
Sad 0.2%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 99.4%
Happy 0.2%
Sad 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 99.7%
Calm 91.5%
Sad 3.6%
Happy 3.3%
Confused 0.5%
Disgusted 0.4%
Surprised 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Male, 99.3%
Calm 91.1%
Sad 3.5%
Happy 3.3%
Surprised 1%
Disgusted 0.4%
Confused 0.3%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 26-36
Gender Male, 99.9%
Calm 75%
Sad 23.7%
Happy 0.5%
Confused 0.5%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Female, 68.7%
Calm 92.3%
Happy 6.4%
Disgusted 0.7%
Confused 0.2%
Angry 0.2%
Sad 0.2%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Happy 85.5%
Calm 13.7%
Surprised 0.3%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 85.3%
Happy 7.4%
Surprised 4.9%
Confused 0.8%
Disgusted 0.8%
Angry 0.3%
Sad 0.3%
Fear 0.2%

AWS Rekognition

Age 40-48
Gender Female, 62%
Calm 97.8%
Happy 0.8%
Sad 0.5%
Confused 0.4%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo 91.4%
a group of people posing for a picture 91.3%
a group of people posing for the camera 91.2%

Text analysis

Google

KODVR--
KODVR-- 2.VEEIA-- ETI W
2.VEEIA--
ETI
W