Human Generated Data

Title

Untitled (man in sailor hat, accompanied by two officers, being booked at police station)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14361

Human Generated Data

Title

Untitled (man in sailor hat, accompanied by two officers, being booked at police station)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.6
Person 99.6
Person 99.4
Person 98.7
Officer 97.6
Military 97.6
Military Uniform 97.6
Clothing 95.5
Apparel 95.5
Helmet 95.5
Sailor Suit 88.6
Hat 88.5
Helmet 88.4
Person 86.5
Captain 78.9

Imagga
created on 2022-01-29

office 38
laptop 37.9
man 36.9
work 36.1
computer 36
business 34
person 33.7
working 33.6
job 32.7
people 32.3
professional 29.9
worker 29.4
male 29.1
technology 27.4
desk 24.5
adult 24.1
happy 23.8
businessman 22.9
corporate 22.3
manager 20.5
smiling 20.2
table 19.6
smile 19.2
businesswoman 19.1
nurse 19
sitting 18
suit 18
executive 17.5
notebook 16.2
success 16.1
negative 15.9
portrait 15.5
education 14.7
communication 14.3
handsome 14.3
businesspeople 14.2
attractive 14
successful 13.7
looking 13.6
modern 13.3
cheerful 13
student 12.8
occupation 12.8
film 12.8
equipment 12.8
home 12.8
women 12.6
team 12.5
science 12.4
indoors 12.3
consultant 11.7
engineer 11.6
workplace 11.4
men 11.2
teamwork 11.1
clothing 10.6
screen 10.5
meeting 10.4
casual 10.2
bright 10
photographic paper 9.9
background 9.9
lab 9.7
secretary 9.6
wireless 9.5
uniform 9.5
smart 9.4
lifestyle 9.4
expression 9.4
face 9.2
coat 9.2
20s 9.2
hand 9.1
medical 8.8
look 8.8
hat 8.7
employee 8.7
device 8.6
career 8.5
doctor 8.5
confident 8.2
stylish 8.1
group 8.1
medicine 7.9
happiness 7.8
laboratory 7.7
elegant 7.7
shirt 7.7
pretty 7.7
30s 7.7
staff 7.6
health 7.6
talking 7.6
tie 7.6
telephone 7.5
one 7.5
glasses 7.4
phone 7.4
emotion 7.4
indoor 7.3
helmet 7.1
together 7

Google
created on 2022-01-29

Hat 92.8
Sleeve 87
Cap 78
Fedora 76.7
Font 73.2
Vintage clothing 72.1
Service 67.9
Room 67.7
Sun hat 66.6
Monochrome photography 66
Nurse 64.6
Event 64.5
Smile 62.7
Stock photography 61.8
Monochrome 60.9
Advertising 58.5
Cooking 57.5
T-shirt 56.6
Suit 55.9
Uniform 55.6

Microsoft
created on 2022-01-29

text 98.4
person 93.6
clothing 93.1
man 90
human face 85.5
black and white 63.4
people 57.7
old 42.2

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 99.5%
Calm 82.7%
Sad 8.9%
Confused 2.4%
Surprised 1.9%
Angry 1.5%
Happy 1.1%
Disgusted 1.1%
Fear 0.4%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 82.7%
Surprised 6.8%
Happy 3.6%
Sad 2.6%
Confused 1.2%
Disgusted 1.2%
Fear 1.1%
Angry 0.8%

AWS Rekognition

Age 49-57
Gender Male, 100%
Happy 49.5%
Calm 36.6%
Surprised 5.7%
Sad 3.9%
Confused 1.5%
Fear 1%
Disgusted 0.9%
Angry 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Helmet 95.5%
Hat 88.5%

Captions

Microsoft

a group of people sitting posing for the camera 93.9%
a group of people posing for a photo 93.2%
a group of people sitting at a table 91.5%

Text analysis

Amazon

OVER
WAR
THE WAR IS NOT OVER
NOT
IS
THE
Our
MJI7
Again
Our Men
MJI7 YT3RAS
Are Bome Again
Are
Men
Bome
YT3RAS

Google

MJI7 YT3RA
YT3RA
MJI7