Human Generated Data

Title

Untitled (several customers at diner counter)

Date

1946

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14561

Human Generated Data

Title

Untitled (several customers at diner counter)

People

Artist: Jack Gould, American

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Building 99.3
Factory 98.7
Clinic 97.9
Person 96.1
Human 96.1
Person 95.4
Assembly Line 93.2
Person 93
Person 86.4
Hospital 84.1
Person 81
Operating Theatre 80.7
Accessories 78.8
Sunglasses 78.8
Accessory 78.8
Person 75.5
Person 68.7
Person 65.5
Person 62.3
Manufacturing 57.8
Person 46

Imagga
created on 2022-01-29

barbershop 29.7
shop 29.5
medical 25.6
room 25.5
people 24
interior 23
work 22.8
professional 22.3
doctor 21.6
hospital 20
mercantile establishment 19.5
patient 18.8
business 18.2
office 17.4
man 16.8
occupation 16.5
working 15.9
medicine 15.8
adult 14.8
modern 14.7
person 14.7
male 14.2
table 14.2
equipment 14.1
indoors 14.1
clinic 13.6
laboratory 13.5
health 13.2
place of business 12.9
lab 12.6
team 12.5
architecture 12.5
restaurant 12.4
research 12.4
men 12
home 12
worker 11.6
job 11.5
design 11.3
nurse 11.2
technology 11.1
service 11.1
women 11.1
indoor 11
coat 10.8
chair 10.7
hall 10.6
biology 10.4
inside 10.1
house 10
specialist 9.9
chemical 9.8
kitchen 9.5
instrument 9.3
city 9.1
human 9
science 8.9
building 8.9
scientist 8.8
scientific 8.7
chemistry 8.7
glass 8.6
profession 8.6
center 8.6
illness 8.6
construction 8.6
case 8.6
furniture 8.4
holding 8.2
lab coat 8.2
drawing 8
decor 8
standing 7.8
development 7.8
travel 7.7
test 7.7
uniform 7.7
counter 7.7
talking 7.6
product 7.6
horizontal 7.5
happy 7.5
floor 7.4
care 7.4
food 7.4
treatment 7.3
smiling 7.2
newspaper 7.2
information 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 98.9
indoor 86.2
black and white 64.5
house 61
several 12.6

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Male, 94.3%
Sad 51.1%
Happy 32.3%
Calm 12.5%
Confused 2.3%
Surprised 0.6%
Angry 0.5%
Disgusted 0.3%
Fear 0.3%

AWS Rekognition

Age 30-40
Gender Female, 58.3%
Calm 98.6%
Sad 0.5%
Happy 0.3%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 99.8%
Calm 90.4%
Sad 3.6%
Happy 3.2%
Confused 1.3%
Surprised 0.6%
Angry 0.3%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 25-35
Gender Male, 96%
Calm 75.6%
Sad 16%
Surprised 2.7%
Confused 2.3%
Happy 0.9%
Angry 0.9%
Disgusted 0.8%
Fear 0.7%

AWS Rekognition

Age 20-28
Gender Female, 96.9%
Calm 99.1%
Sad 0.6%
Happy 0.1%
Confused 0.1%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 19-27
Gender Male, 96.4%
Calm 99.5%
Sad 0.4%
Happy 0.1%
Confused 0%
Angry 0%
Disgusted 0%
Fear 0%
Surprised 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.1%
Sunglasses 78.8%

Captions

Microsoft

a group of people standing in front of a store 72.1%
a group of people in a store 72%
a group of people standing in a room 71.9%

Text analysis

Amazon

SODA
HERE
SODA CHECKS
CHECKS
DINNER
BALCONY
BREAKFAST- BALCONY
BREAKFAST-
ON
Basement
MJI7
Salcony
Silver Salcony
Silver
-
LUNCHEO
MJI7 ACCHA
ACCHA

Google

CHECKS
HERE
Salcony
LUNCHEON
Sher
BREAKFAST-
DINNER
MJI7
YT3RA
SODA
BALCONY
SODA CHECKS HERE Sher Salcony DINNER LUNCHEON BREAKFAST- BALCONY DINNER MJI7 YT3RA