Human Generated Data

Title

Untitled (bride and groom driving away)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.432.48
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (bride and groom driving away)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Person 99.3
Human 99.3
Face 91.5
Apparel 80.2
Clothing 80.2
Hat 80.2
Transportation 75.5
Vehicle 72.8
Automobile 71
Car 71
Finger 58.2
Car Trunk 57.4

Clarifai
created on 2019-03-25

people 99.9
vehicle 99.8
two 99.7
transportation system 99.1
adult 99
group 98.4
three 98.4
man 98.2
facial expression 97.4
woman 96.8
car 95
group together 94.8
indoors 94.7
portrait 94.7
watercraft 93.9
administration 93.9
aircraft 93.7
four 91.6
military 87.6
one 87.3

Imagga
created on 2019-03-25

car 59.2
vehicle 39
driver 34
automobile 30.7
adult 29.8
happy 28.8
sitting 28.4
passenger 27.3
transportation 26.9
person 26.2
smile 25.7
smiling 25.3
auto 24.9
drive 24.6
people 24.6
man 23.5
driving 20.3
toaster 20.1
seat 19.6
male 19.4
inside 19.3
television 18.5
portrait 18.1
home appliance 18
kitchen appliance 16.8
support 16.5
happiness 16.5
new 16.2
attractive 16.1
transport 15.5
business 14.6
wheel 14.2
travel 14.1
telecommunication system 13.8
cheerful 13
appliance 12.9
device 12.8
love 12.6
face 12.1
headrest 12
looking 12
child 12
outdoors 12
window 11.9
pretty 11.9
rest 10.9
family 10.7
fashion 10.6
bride 10.6
human 10.5
couple 10.5
hair 10.3
youth 10.2
work 10.2
model 10.1
20s 10.1
road 9.9
motor vehicle 9.8
working 9.7
one 9.7
women 9.5
world 9.5
luxury 9.4
cute 9.3
wedding 9.2
joy 9.2
holding 9.1
blond 9.1
fun 9
motor 8.7
men 8.6
father 8.4
girls 8.2
dress 8.1
businessman 7.9
look 7.9
brunette 7.8
modern 7.7
casual 7.6
mirror 7.6
tie 7.6
desk 7.6
mobile 7.5
office 7.4
phone 7.4
seat belt 7.3
call 7.3
white goods 7.2
sexy 7.2
mother 7.2
dad 7.2
black 7.2
suit 7.2
handsome 7.1
summer 7.1
day 7.1

Google
created on 2019-03-25

Photograph 97
People 93.1
Snapshot 87.6
Vintage clothing 81.6
Retro style 77.9
Classic 76.7
Photography 75.7
Vehicle 71.9
Fun 70.4
Car 67.7
Photographic paper 65.8
Family 62.3
Father 55.1
Family car 51.5

Microsoft
created on 2019-03-25

car 95.1
person 87.7
old 63.1
black and white 58.8
bus 26.6
retro 25.7
mirror 21.6
train 18.2
monochrome 14.7
child 14.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 99.4%
Confused 0.2%
Angry 0.1%
Surprised 0.3%
Happy 99.1%
Calm 0.1%
Disgusted 0.1%
Sad 0%

AWS Rekognition

Age 26-43
Gender Female, 99.9%
Confused 0.3%
Sad 0.1%
Angry 0.3%
Happy 98.7%
Calm 0.1%
Disgusted 0.1%
Surprised 0.5%

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Hat 80.2%
Car 71%

Captions

Microsoft

a man sitting in a car posing for the camera 88.2%
a man sitting in a car 83.3%
a man sitting on a bus 64.4%