Human Generated Data

Title

Untitled (VE Day: crowd of people on city street buying newspapers)

Date

1945

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15355

Human Generated Data

Title

Untitled (VE Day: crowd of people on city street buying newspapers)

People

Artist: Jack Gould, American

Date

1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 98.8
Human 98.8
Apparel 97.7
Clothing 97.7
Person 97.3
Person 97.1
Person 92.9
Person 90.5
Text 90
Face 85.7
Person 83.5
Head 83.3
Coat 80.2
Overcoat 80.2
Suit 80.2
Poster 77.4
Advertisement 77.4
People 76.8
Crowd 71.6
Photo 65.9
Portrait 65.9
Photography 65.9
Shirt 63.3
Paper 62.5
Flyer 62.5
Brochure 62.5
Person 60

Imagga
created on 2022-03-05

nurse 41.7
medical 28.2
man 28.2
people 27.3
surgeon 25.6
specialist 25.4
person 24.4
professional 23.7
laboratory 23.1
male 22
doctor 21.6
lab 21.4
worker 21.3
work 20.4
medicine 20.2
biology 19.9
scientist 18.6
research 17.1
chemistry 16.4
men 16.3
coat 16.2
team 16.1
health 16
chemical 15.5
science 15.1
instrument 15.1
hospital 15
scientific 14.5
test 14.4
human 14.2
assistant 13.6
patient 13.5
mask 13.4
working 13.3
microscope 12.9
development 12.4
uniform 12.2
adult 12
business 11.5
equipment 11.1
student 11.1
portrait 11
occupation 11
care 10.7
astronaut 10.7
profession 10.5
illness 10.5
technology 10.4
black 10.2
businessman 9.7
happy 9.4
study 9.3
teamwork 9.3
smile 9.3
groom 9.3
wedding 9.2
clinic 8.9
technician 8.8
optical 8.7
education 8.7
exam 8.6
suit 8.1
job 8
smiling 8
genes 7.9
investigation 7.9
love 7.9
chemist 7.9
biotechnology 7.8
surgery 7.8
experiment 7.8
discovery 7.8
sample 7.8
bride 7.7
hand 7.6
room 7.4
brass 7.3
women 7.1
wind instrument 7.1
negative 7
modern 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 99.5
book 94.3
musical instrument 84.6
man 83.1
clothing 82.9
person 79.6

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 72.6%
Calm 95.1%
Surprised 1.8%
Sad 1.5%
Angry 0.5%
Confused 0.4%
Disgusted 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 49-57
Gender Female, 88.7%
Calm 38.1%
Fear 27.2%
Happy 13.5%
Sad 6.9%
Angry 4.6%
Confused 3.6%
Surprised 3.4%
Disgusted 2.6%

AWS Rekognition

Age 24-34
Gender Female, 85.6%
Calm 99.8%
Sad 0.1%
Happy 0%
Confused 0%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 33-41
Gender Female, 67.3%
Happy 98.2%
Calm 0.8%
Fear 0.4%
Surprised 0.3%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 38-46
Gender Male, 92.7%
Calm 31%
Fear 25%
Happy 14.5%
Confused 10%
Surprised 6.6%
Sad 6%
Angry 3.7%
Disgusted 3.1%

AWS Rekognition

Age 24-34
Gender Female, 67.2%
Calm 88%
Happy 8.3%
Sad 1.9%
Confused 0.8%
Surprised 0.4%
Disgusted 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 19-27
Gender Male, 96.1%
Calm 57.8%
Sad 25.9%
Surprised 5%
Happy 4.8%
Angry 3%
Confused 1.4%
Disgusted 1.2%
Fear 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.8%

Captions

Microsoft

a group of people looking at a book 40.5%
a group of people standing next to a book 40.4%
a group of people standing on top of a book 33.4%

Text analysis

Amazon

JAPAN
WITH
JOB
WAR
WAR WITH JAPAN NOW OUR BIG JOB
BIG
SURRENDERS
NOW
VICTORY!
VICTORY! GERMANY SURRENDERS
GERMANY
OUR
EXTRA
ESTIMATE
POST
S
CITY
POST-DISPATCH
NOT
YET
LATEST
ALLIED
IT
HAVE
OFFICIAL
GGS
ALLIED CAPITALS HAVE NOT YET
MADE IT OFFICIAL
a
MADE
CAPITALS
TO CRUSH
CITY ST.LOUIS POST-DISPATCH EXTRA
=
THE MASS
MONTHS
ST. LOUIS GERMANY POST of
VICTORY! - WITH JAPAN NOW SU OUR
10 24
LOUIS
SU
of
MJIR
ST.LOUIS
ST.
10 24 &
MJIR YT3RAS
&
WAR ENIS AT
YT3RAS
-
PLAN

Google

POST-DISPATCHEXTRA
GI
HAVE
JAPAN
CITY
VICTORY!
CAPITALS
IT
OFFE
OUR
ALLIED
NOT
NOW
BIG
JOR
TORY
YET
QUR
CITY ST.LOUIS POST-DISPATCHEXTRA VICTORY! GI ALLIED CAPITALS HAVE NOT YET MADE IT OFFE TH JAPAN NOW QUR BIG JOR YT3RA2 TORY GERMANY WITH JAPAN NOW OUR
ST.LOUIS
MADE
TH
YT3RA2
GERMANY
WITH