Human Generated Data

Title

Untitled (businesspeople at desks in Mercantile Exchange auditorium)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15951

Human Generated Data

Title

Untitled (businesspeople at desks in Mercantile Exchange auditorium)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Person 99.4
Human 99.4
Person 99.1
Person 98.5
Person 98.3
Person 97.9
Person 97.2
Person 97
Person 89.4
Person 88.2
Person 87.4
Person 86.9
Indoors 83
Person 79.4
Person 78.2
Clinic 78.1
Person 75.1
Lab 73.7
Building 72.4
Office 69.5
Person 65.9
Person 60.6
Hospital 55.2

Imagga
created on 2022-03-25

barbershop 94.9
shop 84.5
mercantile establishment 62.1
place of business 41.3
interior 38
room 29.4
table 28
indoors 26.4
chair 25.7
restaurant 23.9
modern 23.1
furniture 21.8
salon 20.8
establishment 20.6
office 20.5
people 19.5
house 19.2
indoor 19.2
home 19.1
window 18.9
work 18.8
man 18.8
clinic 18.6
inside 18.4
design 18
decor 15.9
architecture 15.6
dining 15.2
person 15.1
style 14.8
professional 14.5
male 14.2
medical 14.1
glass 14
luxury 13.7
light 13.4
business 13.4
empty 12.9
occupation 12.8
hospital 12.7
adult 12.3
counter 12.3
doctor 12.2
wall 12
kitchen 11.8
patient 11.7
decoration 11.6
service 11.1
wood 10.8
chairs 10.8
seat 10.7
working 10.6
floor 10.2
bar 10.2
nobody 10.1
dinner 10.1
apartment 9.6
elegant 9.4
contemporary 9.4
building 9.4
drink 9.2
food 9.1
city 9.1
computer 8.8
urban 8.7
lifestyle 8.7
hotel 8.6
comfortable 8.6
men 8.6
lamp 8.6
mirror 8.6
cabinet 8.5
3d 8.5
worker 8.5
care 8.2
stylish 8.1
smiling 8
medicine 7.9
desk 7.9
women 7.9
scene 7.8
lighting 7.7
hairdresser 7.6
two 7.6
meeting 7.5
plant 7.5
teamwork 7.4
equipment 7.4
domestic 7.2
case 7.1
job 7.1
life 7

Google
created on 2022-03-25

Microsoft
created on 2022-03-25

person 98.7
indoor 98.4
text 95.6
table 92.5
furniture 87.1
building 71.4
people 67.2
office building 66.2
room 53.4
black and white 52

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Male, 97%
Calm 59.3%
Sad 28%
Angry 5%
Confused 2.5%
Surprised 1.5%
Happy 1.5%
Fear 1.1%
Disgusted 1.1%

AWS Rekognition

Age 27-37
Gender Male, 99.3%
Calm 79.1%
Angry 8.4%
Disgusted 6.2%
Sad 3.8%
Fear 0.8%
Surprised 0.7%
Happy 0.6%
Confused 0.4%

AWS Rekognition

Age 45-53
Gender Male, 99.8%
Sad 26.2%
Surprised 24.4%
Calm 22.6%
Disgusted 10.2%
Fear 8.2%
Angry 4%
Confused 3%
Happy 1.5%

AWS Rekognition

Age 16-24
Gender Male, 77.2%
Calm 84.1%
Sad 4.8%
Disgusted 4.3%
Fear 3.1%
Happy 1.1%
Angry 1%
Confused 0.9%
Surprised 0.6%

AWS Rekognition

Age 18-26
Gender Male, 55%
Fear 69.4%
Sad 14.2%
Calm 11.3%
Disgusted 1.6%
Surprised 1.1%
Confused 0.9%
Angry 0.7%
Happy 0.7%

AWS Rekognition

Age 19-27
Gender Male, 84.4%
Calm 93.1%
Disgusted 2.2%
Happy 1.5%
Angry 1%
Sad 0.9%
Confused 0.7%
Fear 0.3%
Surprised 0.2%

AWS Rekognition

Age 14-22
Gender Female, 53.2%
Angry 32.8%
Fear 28.9%
Sad 23.4%
Calm 10.9%
Disgusted 1.4%
Happy 0.9%
Surprised 0.8%
Confused 0.7%

AWS Rekognition

Age 11-19
Gender Male, 70.1%
Calm 42.9%
Surprised 17.1%
Sad 16.9%
Happy 7.6%
Confused 4.5%
Angry 4.5%
Disgusted 4.5%
Fear 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people in a room 95.3%
a group of people sitting at a table 82.6%
a group of people sitting around a table 81.9%

Text analysis

Amazon

12
KODAK
SAFETY
KODAK SAFETY ELIM
ELIM

Google

S'AFETY
12
12 DAK S'AFETY
DAK