Human Generated Data

Title

Untitled (workers marching in strike on city street)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15580.1

Human Generated Data

Title

Untitled (workers marching in strike on city street)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.5
Human 99.5
Person 99.4
Person 99.3
Person 99.3
Person 98.6
Person 97.4
Person 96.7
Person 96.3
Person 95.8
Crowd 94.2
Pedestrian 91.3
Person 83.5
Path 81.5
Person 75.4
Leisure Activities 75.1
Musical Instrument 74.1
Musician 74.1
Road 72.7
Person 71.5
Person 69.6
Text 69.4
People 67.2
Festival 66.6
Apparel 66
Clothing 66
Dance Pose 64.5
Parade 56.1
Marching 55.5
Music Band 55.1

Imagga
created on 2022-02-05

daily 28
drawing 20.5
sketch 19.1
people 19
sport 17.9
cricket equipment 16.6
man 16.1
person 15.7
sports equipment 15.6
newspaper 14.7
outdoors 13.4
urban 13.1
male 12.8
business 12.7
city 12.5
adult 12.4
portrait 12.3
staff 12
cricket bat 11.7
product 11.3
equipment 11.3
men 11.2
stick 11
street 10.1
crutch 10
active 9.9
travel 9.9
activity 9.8
life 9.6
black 9.6
representation 9.6
women 9.5
window 9.5
architecture 9.4
grunge 9.4
wicket 9.3
outdoor 9.2
building 9.1
silhouette 9.1
creation 9.1
human 9
snow 8.9
businessman 8.8
art 8.7
day 8.6
motion 8.6
design 8.4
old 8.4
fashion 8.3
sign 8.3
speed 8.2
one 8.2
exercise 8.2
transportation 8.1
posing 8
lifestyle 7.9
standing 7.8
summer 7.7
wall 7.7
structure 7.7
move 7.7
sky 7.6
walking 7.6
power 7.6
poster 7.5
symbol 7.4
teenager 7.3
group 7.3
success 7.2
fitness 7.2
dress 7.2
office 7.2
statue 7.2
face 7.1

Google
created on 2022-02-05

Building 87.5
Gesture 85.3
Black-and-white 83.5
Line 82.2
Font 80.2
Monochrome photography 73.4
Monochrome 73.1
Illustration 71.3
Event 69.3
Uniform 68.7
Poster 67.5
Art 65.5
Crew 65.4
Advertising 65.1
City 64.1
Stock photography 63.5
Pedestrian 62.9
Photo caption 62.7
Window 61.3
Pole 61.1

Microsoft
created on 2022-02-05

text 98.7
black and white 94.1
outdoor 92.3
person 84.9
street 84.8
clothing 62.9
dance 61.7

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 99.6%
Surprised 0.2%
Happy 0%
Disgusted 0%
Confused 0%
Fear 0%
Angry 0%
Sad 0%

AWS Rekognition

Age 23-33
Gender Male, 96.9%
Fear 60.6%
Surprised 17.7%
Calm 11.9%
Disgusted 3.2%
Happy 2%
Angry 2%
Sad 1.4%
Confused 1.2%

AWS Rekognition

Age 34-42
Gender Male, 83.4%
Calm 65.8%
Happy 12.9%
Surprised 8%
Fear 7.8%
Disgusted 2.4%
Confused 1.8%
Angry 0.9%
Sad 0.5%

AWS Rekognition

Age 18-26
Gender Female, 84.5%
Calm 89.3%
Surprised 8.8%
Angry 0.8%
Disgusted 0.6%
Confused 0.2%
Happy 0.1%
Fear 0.1%
Sad 0.1%

AWS Rekognition

Age 24-34
Gender Female, 56.5%
Calm 80%
Disgusted 9.1%
Surprised 4.7%
Confused 3.2%
Angry 1.4%
Sad 0.7%
Fear 0.5%
Happy 0.4%

AWS Rekognition

Age 31-41
Gender Female, 66.4%
Disgusted 83.2%
Confused 4.3%
Angry 3.7%
Calm 2.9%
Surprised 2.1%
Fear 2.1%
Sad 0.9%
Happy 0.9%

AWS Rekognition

Age 37-45
Gender Male, 97.6%
Happy 61.4%
Surprised 21.9%
Fear 6.4%
Calm 4.2%
Angry 2.3%
Sad 1.5%
Confused 1.3%
Disgusted 1.2%

AWS Rekognition

Age 28-38
Gender Male, 86.9%
Calm 90.1%
Sad 4.4%
Confused 1.3%
Angry 1.2%
Surprised 1.1%
Fear 0.8%
Happy 0.6%
Disgusted 0.6%

AWS Rekognition

Age 20-28
Gender Male, 70.8%
Calm 41%
Sad 26.8%
Fear 14.4%
Happy 9.1%
Angry 3%
Confused 2.6%
Surprised 1.9%
Disgusted 1.2%

AWS Rekognition

Age 19-27
Gender Male, 93.8%
Surprised 50.6%
Calm 39.8%
Confused 5.2%
Angry 1.2%
Disgusted 1%
Happy 0.9%
Sad 0.7%
Fear 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a group of people standing in front of a building 92.2%
a group of people in front of a building 91.9%
a group of people posing for a photo in front of a building 87.1%

Text analysis

Amazon

INCREASE
CUT
WAGE CUT
WAGE
PRICE
A
Down!
IS A
UNION
IS
UNION CIO
WORKERS
WAREHOUSE WORKERS
WAREHOUSE
CIO
PRICE a INCREASE
Don't
the
Don't take it Lying Down!
a
it
take
Lying
ROSN

Google

PRICE
it
Down!
WAGE
CUT
Dont
WAREHOUSE
UNION
CIO
PRICE INCREASE IS A WAGE CUT Dont fake it Lying Down! WAREHOUSE WORKERS UNION CIO
A
WORKERS
INCREASE
IS
fake
Lying