Human Generated Data

Title

Untitled (men waiting to check in at airline counter)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14993

Human Generated Data

Title

Untitled (men waiting to check in at airline counter)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 98.9
Person 98.9
Person 98.8
Person 98.5
Person 93.2
Person 92.8
Person 92.3
Person 92.3
Apparel 91.8
Clothing 91.8
Person 77.6
Indoors 72
Room 70.5
Person 69.6
Cafeteria 63.3
Restaurant 63.3
Person 63.3
Coat 57
Overcoat 57
Chef 57
Clinic 56.5
Meal 56.4
Food 56.4

Imagga
created on 2022-03-05

office 43.1
man 37.6
working 35.4
people 34.6
shop 32.3
computer 32.2
professional 32.1
person 31.8
barbershop 30.5
business 29.2
work 29.1
male 27.7
adult 27.6
patient 26
job 23.9
hospital 23.7
worker 23.3
businessman 22.1
doctor 21.6
clinic 21.3
happy 20.7
medical 20.3
smiling 20.3
technology 20
mercantile establishment 19.7
laptop 19.2
team 18.8
medicine 18.5
indoors 18.5
restaurant 18.2
portrait 18.1
desk 17.9
occupation 17.4
health 17.4
nurse 17.4
corporate 17.2
teamwork 16.7
sitting 16.3
table 15.4
room 15.2
specialist 15.1
meeting 15.1
women 15
executive 14.9
men 14.6
success 14.5
communication 14.3
monitor 13.9
businesswoman 13.6
uniform 13.3
place of business 13.3
group 12.9
looking 12.8
modern 12.6
equipment 12.4
education 12.1
care 11.5
illness 11.4
smile 11.4
businesspeople 11.4
coat 11.4
manager 11.2
service 11.1
interior 10.6
laboratory 10.6
keyboard 10.3
case 10.3
two 10.2
student 10.1
confident 10
lab 9.7
expertise 9.7
building 9.7
document 9.3
indoor 9.1
holding 9.1
suit 9
science 8.9
to 8.9
kitchen 8.8
home 8.8
standing 8.7
lifestyle 8.7
center 8.7
30s 8.7
staff 8.6
research 8.6
talking 8.6
industry 8.5
senior 8.4
horizontal 8.4
back 8.3
20s 8.2
successful 8.2
friendly 8.2
employee 7.9
sick person 7.9
sterile 7.9
hairdresser 7.8
two people 7.8
pretty 7.7
test 7.7
attractive 7.7
customer 7.6
workplace 7.6
adults 7.6
career 7.6
showing 7.5
company 7.4
engineer 7.3
salon 7.2
lab coat 7.2
chair 7
together 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 99.3
clothing 95.8
text 95.4
man 77.9
black and white 75.2
people 68
preparing 50.9

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 99.4%
Surprised 57.1%
Sad 29.8%
Calm 7.3%
Angry 2.8%
Disgusted 1.3%
Happy 0.7%
Confused 0.5%
Fear 0.4%

AWS Rekognition

Age 38-46
Gender Male, 99.2%
Calm 80.3%
Happy 12.9%
Surprised 2%
Sad 1.8%
Angry 1.1%
Disgusted 1%
Confused 0.8%
Fear 0.2%

AWS Rekognition

Age 30-40
Gender Male, 100%
Calm 98.9%
Surprised 0.3%
Confused 0.3%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Happy 0.1%
Fear 0%

AWS Rekognition

Age 26-36
Gender Male, 91.1%
Calm 99.9%
Surprised 0.1%
Confused 0%
Sad 0%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 96.3%
Calm 99.9%
Confused 0%
Sad 0%
Surprised 0%
Angry 0%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Male, 86.8%
Sad 47.1%
Angry 26.1%
Surprised 13.7%
Calm 4.7%
Disgusted 3.4%
Fear 2.8%
Happy 1.5%
Confused 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people performing on a counter 88.6%
a group of people standing in a kitchen 87.5%
a group of people standing in front of a counter 87.4%

Text analysis

Amazon

ONTINENT
LINES

Google

...
....
... ONTINENT LINES ....
ONTINENT
LINES