Human Generated Data

Title

Untitled (four men standing by chairs after meeting)

Date

1945

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14696

Human Generated Data

Title

Untitled (four men standing by chairs after meeting)

People

Artist: Jack Gould, American

Date

1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Apparel 99.7
Clothing 99.7
Person 99
Human 99
Person 98.3
Person 97.5
Person 95.9
Hat 78.5
Person 71
Sleeve 67.9
Sailor Suit 64.2
Sun Hat 59
Coat 58.6
Overcoat 58.6
Pants 55.8

Imagga
created on 2022-01-29

man 41
male 34
people 30.7
professional 29.8
person 26.6
business 26.1
worker 24.2
adult 23.8
clothing 23.1
medical 22.9
businessman 22.9
men 22.3
job 21.2
work 21.2
doctor 20.7
coat 20.5
lab coat 17.5
occupation 17.4
corporate 17.2
happy 16.3
office 16
nurse 15.6
hospital 15.6
looking 15.2
uniform 14.8
team 14.3
casual 13.6
patient 13.4
room 13.3
building 13.3
suit 13.2
health 13.2
day 12.5
businesspeople 12.3
medicine 12.3
indoors 12.3
portrait 12.3
group 12.1
clinic 12
handsome 11.6
smiling 11.6
working 11.5
adults 11.4
executive 11.3
clothes 11.2
garment 11.2
engineer 11.1
teamwork 11.1
equipment 10.6
development 10.5
construction 10.3
manager 10.2
surgeon 10.2
indoor 10
smile 10
care 9.9
builder 9.8
lab 9.7
architect 9.6
laboratory 9.6
black 9.6
research 9.5
industry 9.4
senior 9.4
employee 9.4
inside 9.2
success 8.8
scientist 8.8
businessmen 8.8
helmet 8.8
40s 8.8
colleagues 8.7
employment 8.7
women 8.7
standing 8.7
corporation 8.7
education 8.7
profession 8.6
architecture 8.6
serious 8.6
bright 8.6
jacket 8.5
meeting 8.5
modern 8.4
case 8.4
focus 8.3
holding 8.2
confident 8.2
businesswoman 8.2
home 8
days 7.8
color 7.8
chemical 7.8
chemistry 7.7
daytime 7.7
blurred 7.7
two 7.6
tool 7.6
hand 7.6
biology 7.6
window 7.5
human 7.5
blur 7.4
student 7.4
technology 7.4
successful 7.3
computer 7.2
family 7.1
face 7.1
happiness 7

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 98.1
outdoor 92.7
person 90.1
clothing 89
man 85.8
standing 81.7
hat 72.4
drawing 69.4

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Female, 65.3%
Calm 99.9%
Surprised 0%
Confused 0%
Sad 0%
Angry 0%
Happy 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Calm 99.6%
Surprised 0.2%
Sad 0.1%
Angry 0.1%
Confused 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Female, 83.5%
Calm 81.6%
Happy 5.6%
Angry 4.1%
Sad 3.9%
Confused 1.7%
Disgusted 1.4%
Surprised 1.3%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Hat 78.5%

Captions

Microsoft

a group of people standing in front of a window 87.5%
a group of men standing in front of a window 82.5%
a group of people standing next to a window 82.4%

Text analysis

Amazon

MJI7
MJI7 YT37AS ACTUA
YT37AS
ACTUA