Human Generated Data

Title

Untitled (two young men sleeping on train seats)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15367

Human Generated Data

Title

Untitled (two young men sleeping on train seats)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Chair 99.9
Furniture 99.9
Human 99.4
Face 99.4
Apparel 99.2
Clothing 99.2
Person 97.2
Female 95.3
Smile 93.6
Photography 83.7
Photo 83.7
Portrait 83.7
Cushion 83.6
Pillow 83.6
Woman 79.8
Girl 76.9
Head 74
Dress 72.1
Couch 71.1
Table 65.9
Outdoors 63.3
Coat 63.3
Kid 62.4
Child 62.4
Indoors 61.1
Selfie 59.8
Teeth 59.8
Mouth 59.8
Lip 59.8
Plant 59.8
Housing 58.4
Building 58.4
Glasses 58.3
Accessories 58.3
Accessory 58.3
Costume 58.1
Water 57.6
Man 56.3
Laughing 56.1

Imagga
created on 2022-03-05

negative 100
film 92.3
photographic paper 71.3
photographic equipment 47.6
people 24.5
medical 23.8
person 22.7
professional 20.3
surgeon 18.2
adult 17.5
man 17.5
medicine 16.7
doctor 16
patient 15.5
men 15.4
hospital 15.3
health 15.3
mask 14
nurse 13.8
lab 13.6
male 13.5
work 13.3
working 13.2
care 13.2
human 12.7
laboratory 12.5
team 11.6
worker 11.5
equipment 10.8
hand 10.6
profession 10.5
research 10.5
biology 10.4
technology 10.4
love 10.2
instrument 10.2
occupation 10.1
room 10
scientist 9.8
scientific 9.7
chemical 9.6
portrait 9.1
dress 9
black 9
surgery 8.8
chemistry 8.7
test 8.7
bright 8.6
illness 8.6
face 8.5
modern 8.4
holding 8.2
science 8
celebration 8
women 7.9
business 7.9
art 7.8
emergency 7.7
indoor 7.3
office 7.2
hair 7.1
job 7.1
indoors 7

Google
created on 2022-03-05

Sunglasses 87.8
Eyewear 87
Gesture 85.3
Flash photography 84.6
Style 83.8
Black-and-white 83.2
Automotive design 81.4
Comfort 76
Knee 74.6
Audio equipment 74.1
Technology 73.2
Font 71.4
Cameras & optics 69.6
Personal protective equipment 69.5
Monochrome photography 69.4
T-shirt 66.4
Monochrome 66.2
Stock photography 64.9
Sitting 62.5
Room 61.6

Microsoft
created on 2022-03-05

text 98.4
book 94
person 86.9
clothing 85.2
black and white 85.2
human face 73.7

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Female, 71.7%
Calm 95.1%
Confused 2.5%
Surprised 0.8%
Disgusted 0.5%
Sad 0.4%
Angry 0.3%
Happy 0.2%
Fear 0.1%

AWS Rekognition

Age 24-34
Gender Male, 92.9%
Calm 99.3%
Sad 0.3%
Fear 0.2%
Happy 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.2%

Captions

Microsoft

a man holding a book 34.4%
a man standing next to a window 34.3%
a man standing in front of a window 34.2%

Text analysis

Amazon

TOJ
KODAK-
KODAK- SALETA
SALETA