Human Generated Data

Title

Untitled (large crowd of protesters holding signs about high prices)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14950

Human Generated Data

Title

Untitled (large crowd of protesters holding signs about high prices)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14950

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.7
Human 99.7
Person 99.2
Person 96.4
Face 95.2
Poster 92.8
Advertisement 92.8
Audience 91.3
Crowd 91.3
Suit 82.8
Coat 82.8
Clothing 82.8
Overcoat 82.8
Apparel 82.8
Text 79.8
Chair 77.3
Furniture 77.3
Urban 77
City 75.3
Town 75.3
Building 75.3
Collage 73.1
People 72.4
Portrait 71.8
Photography 71.8
Photo 71.8
Female 70.7
Person 70.3
Plant 62.9
Paper 62.1
Downtown 56.3
Man 56.2
Girl 55.2
Tuxedo 55.1

Clarifai
created on 2023-10-29

people 99.9
many 99.9
crowd 99.3
monochrome 99.2
group together 99
street 98.5
group 98.2
man 97.1
adult 96.3
leader 93.9
administration 89.9
audience 86.5
woman 86.3
one 84.1
war 84
wear 83.3
black and white 82.6
city 78.5
square 77.1
portrait 75.7

Imagga
created on 2022-03-05

blackboard 28.9
old 27.8
grunge 26.4
texture 24.3
retro 22.9
vintage 21.5
aged 19.9
room 18.4
rough 18.2
antique 18.2
man 18.1
wall 17.9
pattern 17.8
surface 17.6
dirty 17.2
art 16.2
classroom 15.6
design 15.2
grungy 15.2
ancient 14.7
shop 14.6
salon 14.6
black 13.8
wallpaper 13.8
graphic 13.1
male 12.8
person 12.7
negative 12.7
brown 12.5
people 12.3
office 11.8
paint 11.8
frame 11.6
damaged 11.4
grain 11.1
mercantile establishment 10.8
color 10.6
worn 10.5
rusty 10.5
film 10.4
paper 10.2
material 9.8
modern 9.8
portrait 9.7
textured 9.6
rust 9.6
unique 9.5
floral 9.4
business 9.1
professional 9.1
border 9
computer 8.8
messy 8.7
stained 8.6
flower 8.5
dark 8.3
plants 8.3
adult 8.3
letter 8.2
decoration 8.1
close 8
newspaper 7.8
shoe shop 7.8
parchment 7.7
diagram 7.7
weathered 7.6
barbershop 7.5
contemporary 7.5
decorative 7.5
senior 7.5
city 7.5
plant 7.5
global 7.3
detail 7.2
smiling 7.2
place of business 7.2
lines 7.2
businessman 7.1

Google
created on 2022-03-05

Photograph 94.3
White 92.2
Black 89.9
Building 89.1
Black-and-white 88.5
Style 84.3
Line 82.1
Art 81.9
Monochrome 79.3
People 79
Font 78
Monochrome photography 77.5
Hat 76.7
Snapshot 74.3
Room 72.1
Event 72.1
Crowd 71.4
Skyscraper 68.9
Window 67.6
Suit 66.9

Microsoft
created on 2022-03-05

person 98.1
human face 90.7
people 89.8
text 86.6
clothing 80.5
man 76.7
white 75.3
black 71.9
black and white 71
gallery 55.5
old 47.4
image 31.5
crowd 21.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Female, 93.7%
Calm 95.7%
Surprised 2.2%
Disgusted 0.7%
Happy 0.6%
Sad 0.4%
Angry 0.2%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 35-43
Gender Male, 93.5%
Fear 25.1%
Calm 24.9%
Happy 20.3%
Surprised 10.7%
Confused 8.7%
Sad 6.7%
Disgusted 2.2%
Angry 1.5%

AWS Rekognition

Age 4-12
Gender Female, 98.4%
Calm 79.1%
Sad 11.3%
Happy 4.6%
Surprised 1.4%
Angry 1.2%
Confused 0.9%
Disgusted 0.7%
Fear 0.7%

AWS Rekognition

Age 29-39
Gender Male, 69.7%
Calm 91.1%
Disgusted 2.6%
Sad 2.5%
Happy 0.9%
Fear 0.9%
Confused 0.9%
Angry 0.6%
Surprised 0.4%

AWS Rekognition

Age 35-43
Gender Female, 97.6%
Happy 74.1%
Surprised 13.1%
Confused 2.7%
Sad 2.6%
Fear 2.5%
Disgusted 1.9%
Angry 1.8%
Calm 1.4%

AWS Rekognition

Age 25-35
Gender Female, 64.1%
Calm 90.8%
Happy 4.7%
Sad 3%
Confused 0.7%
Disgusted 0.3%
Surprised 0.3%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Female, 62%
Calm 99%
Sad 0.5%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%
Confused 0%

AWS Rekognition

Age 19-27
Gender Male, 62.1%
Sad 94.4%
Calm 4.7%
Happy 0.3%
Angry 0.3%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Calm 36.9%
Happy 24.6%
Disgusted 20.1%
Fear 7.1%
Confused 3.8%
Surprised 3%
Sad 3%
Angry 1.4%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 99.9%
Surprised 0%
Sad 0%
Confused 0%
Angry 0%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 24-34
Gender Female, 50.1%
Happy 45%
Sad 39.4%
Calm 6.9%
Fear 2.3%
Disgusted 2.1%
Surprised 1.9%
Angry 1.5%
Confused 1%

AWS Rekognition

Age 14-22
Gender Male, 100%
Sad 39.1%
Fear 32.3%
Surprised 6.4%
Disgusted 6.1%
Angry 5.5%
Calm 4.3%
Happy 3.9%
Confused 2.4%

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 61.7%
Confused 14.1%
Disgusted 6.5%
Fear 5.7%
Happy 4%
Sad 3.7%
Surprised 2.6%
Angry 1.7%

AWS Rekognition

Age 35-43
Gender Male, 99.8%
Happy 24.7%
Surprised 23.7%
Angry 19%
Calm 14.2%
Fear 10.5%
Disgusted 3.5%
Sad 2.4%
Confused 1.9%

AWS Rekognition

Age 38-46
Gender Male, 95.2%
Calm 88%
Sad 3.5%
Surprised 2.3%
Angry 1.7%
Fear 1.6%
Disgusted 1.3%
Confused 1.2%
Happy 0.5%

AWS Rekognition

Age 21-29
Gender Male, 68.8%
Calm 70.6%
Happy 8.3%
Sad 7.6%
Angry 6.8%
Surprised 2.3%
Disgusted 2.2%
Fear 1.4%
Confused 0.8%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Angry 32.3%
Sad 28.4%
Calm 24.3%
Happy 10.1%
Fear 1.7%
Surprised 1.2%
Disgusted 1.1%
Confused 0.8%

AWS Rekognition

Age 28-38
Gender Male, 93%
Happy 64.4%
Calm 25.3%
Fear 4.3%
Confused 2%
Disgusted 1.4%
Surprised 1%
Sad 0.9%
Angry 0.7%

AWS Rekognition

Age 28-38
Gender Female, 51.2%
Happy 68.7%
Sad 23.7%
Disgusted 2.4%
Calm 2.2%
Angry 1%
Surprised 0.9%
Fear 0.8%
Confused 0.3%

AWS Rekognition

Age 25-35
Gender Female, 60%
Calm 98.5%
Happy 1%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Confused 0.1%
Sad 0.1%
Surprised 0%

AWS Rekognition

Age 23-31
Gender Male, 99.4%
Calm 67.5%
Confused 11.6%
Sad 5.3%
Angry 5%
Happy 3.9%
Surprised 3.2%
Disgusted 2.5%
Fear 1%

AWS Rekognition

Age 36-44
Gender Female, 58.2%
Calm 70.1%
Happy 16.7%
Confused 5.3%
Sad 3.7%
Disgusted 1.6%
Surprised 1.2%
Fear 0.8%
Angry 0.7%

AWS Rekognition

Age 20-28
Gender Female, 85.4%
Happy 35%
Sad 20.4%
Surprised 12.7%
Angry 11.6%
Confused 9.4%
Fear 5.5%
Calm 2.8%
Disgusted 2.7%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 52.5%
Angry 15.9%
Sad 13.4%
Happy 7.2%
Confused 5.1%
Surprised 2.3%
Fear 2%
Disgusted 1.6%

AWS Rekognition

Age 24-34
Gender Male, 98.8%
Happy 94.1%
Calm 1.5%
Disgusted 1.3%
Fear 1.1%
Angry 0.7%
Sad 0.6%
Surprised 0.4%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Poster
Person 99.7%
Person 99.2%
Person 96.4%
Person 70.3%
Poster 92.8%

Text analysis

Amazon

DROP
Old
New
the New
the
Buy
PRICE
CES DROP
CONTROL
FIGHT
air the Old
CES
UP
Repair
PRICES
Repair the Old
UNTIL
ON
UNTIL PRICES DROP
RS
air
LATER
STANDARD
LIVING
INSIST ON
INSIST
Repair he Old
DEPRESSION
HER
NOW
he
t Buy the New
Dont Buy the New
ORIO
WAREI...
Dont
t
CIO
AVOID
NOW y
UNION CIO
UNITE
KIA
kcal)
Comm
UNION
SAVE YOUR
CO
KAZ
-
BLUE
SKIN CO
ن
y
SC CUT
INCEIRE
AIN
POR AIN
POR
SKIN
para

Google

HER Repair the Old Dont Buy the New LUNTIL PRICES DROP FIGHT air the Old Buy the New Repair he Old the New SPEAK NOW UP STANDARD IGHT NOW LIVING INSIST ON PRICE CONTROL CES DROP AVOD NTIL PRICES DROP GEEG
HER
Repair
the
Old
Dont
Buy
New
LUNTIL
PRICES
DROP
FIGHT
air
he
SPEAK
NOW
UP
STANDARD
IGHT
LIVING
INSIST
ON
PRICE
CONTROL
CES
AVOD
NTIL
GEEG