Human Generated Data

Title

Untitled (workers marching on city street)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15581.1

Human Generated Data

Title

Untitled (workers marching on city street)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-05

Person 99.6
Human 99.6
Person 99.6
Person 99.3
Person 96.6
Person 95.1
Crowd 95.1
Parade 93.4
Person 93.3
Clothing 92.7
Apparel 92.7
Person 91.3
Person 90.3
Person 89.8
Protest 87.5
Word 83.5
Person 82.4
Advertisement 81
Poster 81
Text 80.6
People 73
Person 69.3
Shorts 63.1
Face 60.4
Person 58.8
Paper 58.3
Brochure 58.3
Flyer 58.3
Female 55.4
Person 53.8

Imagga
created on 2022-02-05

newspaper 66.8
product 51.4
creation 40.9
negative 31
grunge 30.6
vintage 28.1
film 25.9
old 25.8
black 21
aged 19.9
texture 19.4
art 18.9
grungy 17.1
photographic paper 15.6
antique 15.6
paint 15.4
decoration 14.7
retro 14.7
space 14.7
pattern 14.4
dirty 13.6
room 13.5
daily 13.5
wall 13
ancient 13
graphic 12.4
landscape 11.2
people 11.2
rough 10.9
frame 10.8
structure 10.7
design 10.7
light 10.7
textured 10.5
text 10.5
photographic equipment 10.4
border 9.9
material 9.8
backgrounds 9.7
style 9.6
forest 9.6
drawing 9.4
paper 9.4
snow 9.4
classroom 9.4
grain 9.2
city 9.1
silhouette 9.1
person 9.1
surface 8.8
cold 8.6
dirt 8.6
empty 8.6
weathered 8.5
tree 8.5
decorative 8.3
dark 8.3
color 8.3
man 8.1
cool 8
artistic 7.8
rock 7.8
male 7.8
blank 7.7
aging 7.7
winter 7.7
worn 7.6
canvas 7.6
wood 7.5
symbol 7.4
fence 7.4
brown 7.4

Google
created on 2022-02-05

Black 89.9
Shorts 88.7
Black-and-white 86.2
Style 84
Font 78.8
Monochrome photography 75.3
Monochrome 75.2
Snapshot 74.3
Event 71.7
Crew 70.8
T-shirt 70.3
Building 69.1
Art 69.1
Tree 68.9
Rectangle 66.7
Room 64.2
Stock photography 63.8
Crowd 63.3
History 62.7
Vintage clothing 60.3

Microsoft
created on 2022-02-05

text 98.8
clothing 94.3
person 90
group 79.8
man 79
old 78.9
posing 78.7
people 56.2
clothes 17.4
crowd 0.6

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Female, 84.4%
Calm 92.4%
Surprised 3.7%
Happy 3%
Sad 0.3%
Fear 0.3%
Disgusted 0.2%
Confused 0.1%
Angry 0.1%

AWS Rekognition

Age 23-33
Gender Male, 52.9%
Calm 91%
Fear 7.1%
Happy 0.9%
Sad 0.6%
Disgusted 0.2%
Angry 0.1%
Confused 0.1%
Surprised 0.1%

AWS Rekognition

Age 33-41
Gender Female, 85.5%
Happy 59.8%
Calm 36.5%
Disgusted 1.5%
Surprised 0.7%
Fear 0.5%
Sad 0.4%
Confused 0.4%
Angry 0.3%

AWS Rekognition

Age 36-44
Gender Male, 60.6%
Happy 83.7%
Calm 6.2%
Surprised 4.6%
Fear 2.2%
Sad 1.6%
Angry 0.7%
Disgusted 0.6%
Confused 0.3%

AWS Rekognition

Age 50-58
Gender Female, 64%
Happy 95.4%
Calm 3.9%
Surprised 0.3%
Confused 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 23-31
Gender Male, 97%
Happy 41.1%
Calm 33.4%
Sad 9.7%
Angry 4.8%
Fear 3.2%
Surprised 3.1%
Disgusted 2.8%
Confused 1.8%

AWS Rekognition

Age 30-40
Gender Female, 54%
Calm 44.4%
Sad 39.7%
Happy 6.6%
Disgusted 2.8%
Confused 1.8%
Fear 1.7%
Surprised 1.6%
Angry 1.5%

AWS Rekognition

Age 27-37
Gender Male, 88.9%
Happy 91.6%
Angry 3.4%
Surprised 1.2%
Calm 1.2%
Sad 0.9%
Disgusted 0.7%
Fear 0.5%
Confused 0.4%

AWS Rekognition

Age 47-53
Gender Male, 93%
Happy 46.9%
Calm 41.7%
Sad 3.8%
Confused 2.2%
Angry 1.8%
Surprised 1.8%
Disgusted 1.2%
Fear 0.5%

AWS Rekognition

Age 21-29
Gender Female, 68%
Calm 94.7%
Fear 1.3%
Disgusted 1.1%
Surprised 0.9%
Happy 0.8%
Sad 0.4%
Angry 0.4%
Confused 0.3%

AWS Rekognition

Age 13-21
Gender Female, 61.4%
Fear 91%
Sad 2.9%
Happy 2.7%
Surprised 1%
Calm 0.8%
Angry 0.7%
Disgusted 0.4%
Confused 0.4%

AWS Rekognition

Age 31-41
Gender Female, 97.7%
Calm 68%
Happy 11.2%
Sad 7.2%
Angry 6.6%
Fear 4%
Disgusted 1.4%
Surprised 1%
Confused 0.6%

AWS Rekognition

Age 20-28
Gender Male, 87.5%
Calm 85%
Happy 4.9%
Angry 4.5%
Surprised 1.6%
Confused 1.5%
Sad 1.4%
Disgusted 0.7%
Fear 0.5%

AWS Rekognition

Age 21-29
Gender Male, 79.1%
Calm 79.9%
Fear 12.4%
Happy 3.3%
Surprised 1.2%
Sad 1%
Confused 0.9%
Disgusted 0.8%
Angry 0.5%

AWS Rekognition

Age 21-29
Gender Male, 99.8%
Calm 97.2%
Sad 1.1%
Angry 0.7%
Surprised 0.4%
Fear 0.2%
Happy 0.2%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 34-42
Gender Female, 70.8%
Happy 60.6%
Calm 34.1%
Confused 1.6%
Disgusted 1.2%
Surprised 0.9%
Angry 0.7%
Sad 0.5%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a group of people posing for a photo 93.1%
a vintage photo of a group of people posing for the camera 90.5%
a vintage photo of a group of people posing for a picture 90.4%

Text analysis

Amazon

STOP
RENT
RISING RENT
United
PRIC
RISING
ers
VE
United Di
PRICES
FOOD
FIGHT
Di
on
YOUR
LOCAI
MUST
FOOD COSTS
SAVE
BE
BE KEPT
INSIST on
KEPT
SAVE TO YOUR
NO
FIGHT NO
STANDARD
COSTS
INSIST
TO
AVOI
OF
DOWN!
S!
LATI
INFLATION!
AND
DEPRESS
LIVING/
°C
IID
ГОГАК IID
ГОГАК

Google

FIGHT FIGHT CACAK LID SAVE YOUR STANDARD LIVING/ NO PRICES FIGHT AVOI MUST BE KEPT DEPRES INFLATION LATI STOP RISING RENT DOWN FOOD COSTS United Di on INSIST PRIC C ers VE LOCAI N
CACAK
SAVE
KEPT
INFLATION
RENT
FOOD
ers
VE
FIGHT
STANDARD
INSIST
LOCAI
YOUR
NO
PRICES
LATI
STOP
RISING
Di
PRIC
N
LIVING/
AVOI
COSTS
on
C
LID
MUST
BE
DEPRES
DOWN
United