Human Generated Data

Title

Untitled (Oldsmobile sales team)

Date

c. 1940

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1743

Human Generated Data

Title

Untitled (Oldsmobile sales team)

People

Artist: John Deusing, American active 1940s

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 99.8
Apparel 99.8
Person 99.5
Human 99.5
Person 99.5
Person 99
Person 98.9
Person 98.8
Person 98.7
Person 98.5
Person 98.3
Chair 97.5
Furniture 97.5
Person 93.2
Accessories 92.5
Tie 92.5
Accessory 92.5
Text 89.5
Crowd 83.3
Shorts 79.4
Face 74.2
People 73.4
Dress 72.7
Suit 70.7
Overcoat 70.7
Coat 70.7
Hat 67.5
Female 66.6
Portrait 66.4
Photography 66.4
Photo 66.4
Girl 61.8
Kid 61.6
Child 61.6
Shoe 59.5
Footwear 59.5
Smile 55.3
Shoe 54.8

Imagga
created on 2021-12-14

newspaper 51.4
product 39.6
people 34.5
creation 31.5
person 30.2
daily 29.8
male 29.8
man 28.2
men 20.6
businessman 20.3
business 17.6
nurse 17
group 15.3
silhouette 14.9
couple 13.9
adult 13.9
hand 13.7
happy 12.5
black 12
success 11.3
room 10.6
human 10.5
women 10.3
work 10.2
symbol 10.1
team 9.8
sign 9.8
portrait 9.7
chart 9.5
education 9.5
drawing 9.4
student 9.4
youth 9.4
teacher 9
design 9
teaching 8.8
happiness 8.6
party 8.6
two 8.5
modern 8.4
worker 8.3
blackboard 8.2
planner 8.1
school 8
job 8
smiling 7.9
love 7.9
together 7.9
boy 7.8
board 7.8
sport 7.8
dance 7.8
crowd 7.7
old 7.7
patient 7.6
child 7.6
finance 7.6
classroom 7.6
player 7.5
senior 7.5
leisure 7.5
active 7.3
new 7.3
office 7.2
looking 7.2
smile 7.1
sky 7

Google
created on 2021-12-14

Shirt 94
Black-and-white 86.2
Style 84
Font 80.6
Event 73.7
Monochrome photography 73.5
Monochrome 72.7
T-shirt 69.4
Team 68.1
Recreation 66.8
Fun 65.1
Sitting 63.6
Suit 62.5
Photo caption 59.9
Curtain 58.8
Crew 57.8
Crowd 57.6
Room 56
Advertising 54.5

Microsoft
created on 2021-12-14

text 99.6
clothing 97.2
man 88.8
posing 87.5
newspaper 86.6
person 86.6
group 61.3

Face analysis

Amazon

Google

AWS Rekognition

Age 38-56
Gender Male, 96%
Happy 77.2%
Calm 10.6%
Angry 4.2%
Sad 3.1%
Confused 2.9%
Surprised 1.3%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 36-52
Gender Male, 96.4%
Calm 43.2%
Happy 22.7%
Surprised 12.6%
Confused 11.7%
Sad 3.9%
Fear 2.6%
Angry 2.1%
Disgusted 1.2%

AWS Rekognition

Age 36-52
Gender Male, 71.7%
Surprised 59.2%
Happy 21.6%
Fear 6.4%
Calm 4.5%
Confused 3.9%
Sad 3.4%
Angry 0.7%
Disgusted 0.4%

AWS Rekognition

Age 22-34
Gender Male, 65.2%
Happy 85.8%
Calm 6.7%
Angry 2.6%
Sad 2.2%
Surprised 1.4%
Fear 0.7%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 22-34
Gender Male, 71.1%
Sad 58.2%
Calm 27.2%
Happy 6.2%
Angry 3.5%
Surprised 1.9%
Confused 1.7%
Disgusted 0.7%
Fear 0.7%

AWS Rekognition

Age 51-69
Gender Male, 91.1%
Calm 53.9%
Happy 19.4%
Surprised 9.5%
Sad 7.6%
Confused 3.2%
Fear 3%
Angry 2.5%
Disgusted 0.9%

AWS Rekognition

Age 44-62
Gender Male, 66.3%
Sad 57.2%
Happy 22.7%
Calm 13.5%
Angry 2.7%
Confused 2%
Fear 1.1%
Surprised 0.6%
Disgusted 0.2%

AWS Rekognition

Age 28-44
Gender Male, 98.7%
Calm 67.4%
Surprised 13.4%
Happy 8.3%
Angry 4.6%
Sad 2.4%
Confused 2.4%
Fear 1.3%
Disgusted 0.3%

AWS Rekognition

Age 48-66
Gender Male, 58.6%
Calm 74.1%
Happy 23.1%
Sad 1.2%
Surprised 0.7%
Confused 0.3%
Angry 0.3%
Fear 0.2%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 92.5%
Shoe 59.5%

Captions

Microsoft

a group of people posing for a photo 93.3%
a group of people posing for the camera 93.2%
a group of people posing for a picture 93.1%

Text analysis

Amazon

DRIVE
HYDRA-MATIC
with
Oldsmobile's
-
EAI
om -
fone
om

Google

with Oldsmobile's HYDRA-MATIC DRIVE
DRIVE
HYDRA-MATIC
with
Oldsmobile's