Human Generated Data

Title

Untitled (man in long coat and man in overalls talking outside building)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14632

Human Generated Data

Title

Untitled (man in long coat and man in overalls talking outside building)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99.3
Human 99.3
Person 98.2
Apparel 97.4
Clothing 97.4
Officer 96.4
Military 96.4
Military Uniform 96.4
Footwear 88.2
Shoe 88.2
Overcoat 78.2
Coat 78.2
Sailor Suit 68.5
Nature 66.3
Outdoors 62.6
Standing 61.1
Captain 59.3
Suit 58.3

Imagga
created on 2022-01-29

groom 44.4
dress 28
bride 26
people 24.5
wedding 23.9
adult 22.2
man 22.2
person 20.8
male 19.1
pay-phone 17.8
love 17.3
happiness 16.4
portrait 16.2
looking 16
telephone 15.8
couple 15.7
happy 15.7
gown 14.9
married 14.4
celebration 14.3
smile 14.2
pretty 14
veil 13.7
marriage 13.3
clothing 13.3
lady 13
men 12.9
women 12.6
attractive 12.6
electronic equipment 12.1
fashion 12
human 12
equipment 11.8
day 11.8
cash machine 11.4
outdoors 11.2
machine 11.1
business 10.9
model 10.9
bridal 10.7
face 10.6
suit 10.6
device 10.3
two 10.2
smiling 10.1
lifestyle 10.1
old 9.7
cheerful 9.7
businessman 9.7
one 9.7
ceremony 9.7
bouquet 9.4
wall 9.4
life 9.1
wed 8.8
home 8.8
full length 8.7
clothes 8.4
outdoor 8.4
traditional 8.3
new 8.1
posing 8
decoration 8
hair 7.9
black 7.9
cute 7.9
look 7.9
holiday 7.9
brunette 7.8
culture 7.7
elegance 7.5
room 7.5
closeup 7.4
call 7.2
negative 7.2
religion 7.2
bright 7.1
family 7.1
costume 7.1
to 7.1
interior 7.1
indoors 7
modern 7

Google
created on 2022-01-29

Coat 89.2
Standing 86.4
Sleeve 85.8
Gesture 85.3
Black-and-white 83.6
Window 81
Collar 79
Monochrome photography 76.5
Door 73.3
Monochrome 73.1
Uniform 72.5
Suit 72.3
Building 71.8
Classic 71.8
Hat 69.2
Vintage clothing 68.7
Duster 67.1
History 63.2
Art 63.1
Stock photography 62.3

Microsoft
created on 2022-01-29

text 99.3
outdoor 89
clothing 78.7
person 63.5
black and white 53.4

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Female, 50.8%
Calm 26.1%
Surprised 25.2%
Happy 22.4%
Angry 14.6%
Confused 4.3%
Disgusted 3.1%
Sad 2.4%
Fear 1.8%

AWS Rekognition

Age 52-60
Gender Male, 58.2%
Calm 94%
Happy 3.2%
Confused 1%
Sad 1%
Disgusted 0.4%
Angry 0.2%
Surprised 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 88.2%

Captions

Microsoft

a man standing in front of a building 83.8%
a man standing in front of a store 78.6%
a man that is standing in front of a building 78.5%

Text analysis

Amazon

MORE
EQUIP
CROF
ONDS
8
COAL
THAT
A CROF
FIREMAN
A
RON
6
РОТ
MJI7
RON olic COAL Burner FIREMAN
GENERA
MJI7 YESTAD ARAA
Burner
ARAA
olic
YESTAD

Google

GENERA
IRE
e
EQUIPA
A
MORE
A7AA
CROF
MJI7
POT EQUIPA GENERA A CROF IRE MORE ONDS e COAL MJI7 YT37A2 A7AA
ONDS
COAL
POT
YT37A2