Human Generated Data

Title

Untitled (men posing with fish in studio, Manchester, New Hampshire)

Date

c. 1937, printed later

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.91

Human Generated Data

Title

Untitled (men posing with fish in studio, Manchester, New Hampshire)

People

Artist: Durette Studio, American 20th century

Date

c. 1937, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 99.6
Person 99.6
Person 99.6
Person 99.4
Person 99.3
Person 98.5
Advertisement 81.1
Poster 81.1
People 75.6
Door 65.6
Face 65.4
Apparel 57.9
Clothing 57.9
Art 57.5
Overcoat 56.8
Coat 56.8
Suit 55.2

Imagga
created on 2021-12-14

television 100
telecommunication system 54.4
broadcasting 38.8
telecommunication 28.2
black 19.8
medium 18.8
web site 15.7
male 15.6
man 15.4
silhouette 14.1
people 13.4
old 13.2
art 13.1
kin 13
person 12.6
vintage 12.4
monitor 12.2
design 11.2
office 11.2
retro 10.6
grunge 10.2
symbol 9.4
business 9.1
window 8.3
frame 8.3
letter 8.2
equipment 7.9
circa 7.9
postmark 7.9
postage 7.9
postal 7.8
blackboard 7.8
envelope 7.8
ancient 7.8
portrait 7.8
stamp 7.7
men 7.7
mail 7.7
dark 7.5
one 7.5
aged 7.2
dirty 7.2
night 7.1
businessman 7.1

Google
created on 2021-12-14

Microsoft
created on 2021-12-14

text 98.4
clothing 98.4
man 95
person 86.8
posing 85.6
standing 84.1
group 79.1
old 74.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 27-43
Gender Male, 98.8%
Calm 98.9%
Sad 0.4%
Happy 0.2%
Angry 0.2%
Surprised 0.1%
Confused 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 36-52
Gender Male, 99%
Calm 96.3%
Sad 1.7%
Angry 1.4%
Fear 0.2%
Confused 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 32-48
Gender Male, 91.5%
Calm 92.9%
Surprised 2.7%
Angry 1.6%
Sad 1.1%
Happy 0.5%
Fear 0.5%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 32-48
Gender Male, 99.4%
Calm 95.9%
Sad 1.5%
Angry 0.9%
Happy 0.6%
Confused 0.6%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 22-34
Gender Male, 97.6%
Calm 99.7%
Sad 0.1%
Surprised 0.1%
Angry 0%
Happy 0%
Fear 0%
Disgusted 0%
Confused 0%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Poster 81.1%

Captions

Microsoft

a group of people posing for a photo 96.2%
a group of people posing for a photo in front of a window 93.4%
a group of people standing in front of a window posing for the camera 90.7%

Text analysis

Amazon

25%
E
PHOTO
PHOTO E 25% 055-85
055-85

Google

25%
E
FHOTD E 25%
FHOTD