Human Generated Data

Title

Untitled (couple posed looking at their two children during Christmas party)
Date

1962
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9877

Human Generated Data

Title

Untitled (couple posed looking at their two children during Christmas party)

People

Artist: Martin Schweig, American 20th century

Date

1962

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Apparel 100
Clothing 100
Shorts 100
Human 99.6
Person 99.6
Person 99.5
Person 99.3
Person 99
Female 97.2
Woman 87.2
Tie 84.4
Accessories 84.4
Accessory 84.4
Dress 81.1
People 81.1
Smile 79.5
Face 79.5
Girl 77.6
Child 76.9
Kid 76.9
Coat 74.1
Suit 74.1
Overcoat 74.1
Sunglasses 68.3
Skirt 68
Teen 66.7
Pants 62.6
Photo 62.5
Photography 62.5
Tree 62.5
Plant 62.5
Portrait 62.4
Play 59.2
Man 59.1
Blonde 58.5
Furniture 56.8
Boy 56
Couch 55.8
Advertisement 55.3
Collage 55.3
Poster 55.3

Imagga
created on 2022-01-28

man 31.6
beach 31.2
sport 30.2
silhouette 28.2
people 27.9
male 24.4
person 24
sunset 22.5
athlete 21.8
sea 21.1
adult 18.5
sand 17.6
couple 17.4
boy 17.4
sky 17.2
men 17.2
summer 16.7
lifestyle 16.6
vacation 16.4
active 15.9
outdoors 15.7
child 15.6
ball 15.2
runner 15.2
love 15
water 14.7
family 14.2
father 14
black 13.8
happy 13.8
happiness 13.3
ocean 13.3
walking 13.3
together 13.1
outdoor 13
play 12.9
shore 12.1
fun 12
life 11.8
contestant 11.8
exercise 11.8
kin 11.8
sports equipment 11.7
leisure 11.6
run 11.6
equipment 10.8
cricket bat 10.7
running 10.6
cricket equipment 10.6
human 10.5
player 10.5
evening 10.3
youth 10.2
dad 9.7
businessman 9.7
portrait 9.7
sun 9.7
women 9.5
sunny 9.5
mother 9.4
relationship 9.4
friendship 9.4
two 9.3
holiday 9.3
parent 9.2
fitness 9
sunlight 8.9
group 8.9
dusk 8.6
walk 8.6
travel 8.5
joy 8.4
holding 8.3
game equipment 8.2
son 8.2
team 8.1
body 8
world 7.9
soccer ball 7.8
husband 7.6
relax 7.6
landscape 7.4
planner 7.4
coast 7.2
shadow 7.2
activity 7.2
kid 7.1

Google
created on 2022-01-28

Footwear 98.3
Photograph 94.3
Black 89.5
Building 87.5
Black-and-white 86.1
Window 85.3
Gesture 85.3
Style 84
Plant 81.7
Happy 77.4
Art 75.9
Monochrome 74.8
Snapshot 74.3
Monochrome photography 73.7
Room 71.8
Event 71.2
Vintage clothing 69.7
Photo caption 66.2
Suit 64.8
Sitting 63

Microsoft
created on 2022-01-28

text 98.9
outdoor 97.5
person 97.2
clothing 88.5
black and white 77.7
man 61.9
footwear 56

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 79.1%
Calm 97.2%
Sad 2.5%
Fear 0.1%
Disgusted 0.1%
Angry 0%
Happy 0%
Confused 0%
Surprised 0%

AWS Rekognition

Age 33-41
Gender Female, 58.5%
Calm 92.4%
Happy 6.4%
Confused 0.3%
Sad 0.3%
Disgusted 0.3%
Surprised 0.2%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Tie 84.4%
Sunglasses 68.3%

Captions

Microsoft

a group of people posing for the camera 94.7%
a group of people posing for a picture 94.6%
a group of people posing for a photo 92.3%

Text analysis

Amazon

LED