Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)

Date

December 1933-March 1934

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4241

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4241

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 98.7
Human 98.7
Person 97.6
Person 96.5
Person 95.5
Person 93.7
Person 93.6
Crowd 92.8
Interior Design 92.5
Indoors 92.5
Person 91.2
Person 85.8
Person 85.8
Text 85.2
Person 84.4
Person 83.1
Person 82.7
Person 81.5
Person 81.2
Military 80.1
People 73.6
Person 68.6
Person 68.4
Person 68.3
Screen 68.3
Electronics 68.3
Person 67.9
Parade 66.7
Military Uniform 64.8
Room 64.5
Person 63.9
Person 63.9
Person 62.3
Person 61.2
Person 60.7
Protest 59.6
Person 58.7
Person 58.3
Person 55.8
Person 54.7
Person 49
Person 48.3
Person 45.9
Person 44.1

Clarifai
created on 2023-10-25

people 99.9
group 98.6
group together 97.3
wear 97.2
adult 96.4
soldier 96.1
military 96
many 95.8
child 95.3
art 92.4
man 92.1
street 92.1
boy 91.2
war 90.1
one 84.1
uniform 83.8
print 83.7
veil 82.3
administration 82
weapon 79.8

Imagga
created on 2022-01-08

freight car 72.6
car 55.1
wheeled vehicle 43.9
grunge 32.4
old 29.3
vintage 28.9
vehicle 28.7
antique 23.4
art 22.8
decoration 22.4
graffito 22.1
architecture 21.9
texture 20.8
structure 20.8
retro 18.8
frame 18.3
grungy 18
border 17.2
pattern 16.4
rough 16.4
dirty 16.3
history 16.1
city 15.8
design 15.8
black 15.6
building 15.5
damaged 15.3
old fashioned 15.2
paper 14.9
tourism 14.8
conveyance 14.8
ancient 14.7
paint 14.5
material 14.3
space 14
graphic 13.9
landmark 13.5
edge 13.5
travel 13.4
aged 12.7
wall 12.3
historic 11.9
landscape 11.9
frames 11.7
noise 11.7
messy 11.6
weathered 11.4
text 11.3
artistic 11.3
grain 11.1
house 10.9
designed 10.8
scratch 10.7
collage 10.6
rust 10.6
textured 10.5
film 10
noisy 9.9
scratches 9.8
layered 9.8
your 9.7
stain 9.6
brown 9.6
negative 9.3
tower 9
digital 8.9
mess 8.8
photographic 8.8
computer 8.8
movie 8.7
layer 8.7
water 8.7
detailed 8.7
rustic 8.6
mask 8.6
dirt 8.6
historical 8.5
window 8.3
effect 8.2
scenery 8.1
religion 8.1
romantic 8
river 8
highly 7.9
urban 7.9
slide 7.8
color 7.8
strip 7.8
fountain 7.8
empty 7.7
decay 7.7
blank 7.7
construction 7.7
wallpaper 7.7
sky 7.6
outdoor 7.6
worn 7.6
decorative 7.5
vacation 7.4
holiday 7.2

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 97.6
person 96.4
group 86.4
clothing 77.1
standing 76.3
old 75.1
people 74.7
white 63
line 28
several 13.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 20-28
Gender Male, 97.4%
Angry 56.7%
Surprised 23.6%
Calm 10.2%
Fear 5.3%
Happy 1.9%
Disgusted 1%
Sad 0.9%
Confused 0.4%

AWS Rekognition

Age 21-29
Gender Male, 83.8%
Calm 99.2%
Angry 0.3%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%
Confused 0.1%
Happy 0%

AWS Rekognition

Age 19-27
Gender Male, 50.6%
Calm 93.1%
Angry 2%
Sad 1.4%
Happy 1.4%
Surprised 1%
Fear 0.5%
Disgusted 0.4%
Confused 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.2%
Calm 87.1%
Surprised 4%
Angry 3.1%
Happy 1.9%
Disgusted 1.5%
Sad 1%
Confused 0.8%
Fear 0.6%

AWS Rekognition

Age 7-17
Gender Female, 96.7%
Angry 36.9%
Happy 29.9%
Fear 11.5%
Surprised 8.9%
Calm 8.4%
Confused 1.9%
Disgusted 1.5%
Sad 1.1%

AWS Rekognition

Age 16-22
Gender Male, 56.6%
Calm 98.5%
Sad 0.4%
Angry 0.3%
Disgusted 0.3%
Confused 0.2%
Happy 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 87.1%
Calm 68.7%
Angry 25.5%
Surprised 3.4%
Sad 1.2%
Disgusted 0.4%
Fear 0.3%
Confused 0.2%
Happy 0.2%

AWS Rekognition

Age 6-14
Gender Female, 80.9%
Angry 34.9%
Calm 29.6%
Confused 9.8%
Sad 7.8%
Fear 6.9%
Surprised 5.2%
Disgusted 4.1%
Happy 1.5%

AWS Rekognition

Age 33-41
Gender Male, 99.9%
Calm 86.3%
Surprised 3.8%
Fear 3.7%
Sad 2.8%
Angry 1.3%
Disgusted 1.1%
Confused 0.6%
Happy 0.4%

AWS Rekognition

Age 23-31
Gender Female, 89%
Calm 45.6%
Angry 33.1%
Sad 10.9%
Surprised 3.2%
Fear 2.4%
Disgusted 2.3%
Happy 1.7%
Confused 0.9%

AWS Rekognition

Age 9-17
Gender Male, 90%
Calm 91.7%
Angry 2.6%
Fear 1.4%
Sad 1.4%
Disgusted 1.2%
Confused 0.7%
Happy 0.7%
Surprised 0.3%

AWS Rekognition

Age 21-29
Gender Female, 96.9%
Calm 94.8%
Angry 1.3%
Disgusted 1.3%
Sad 1.1%
Happy 0.6%
Surprised 0.4%
Confused 0.3%
Fear 0.3%

AWS Rekognition

Age 20-28
Gender Male, 93.6%
Calm 78.8%
Fear 5.7%
Confused 4.7%
Sad 4.4%
Angry 1.9%
Happy 1.9%
Disgusted 1.4%
Surprised 1.2%

AWS Rekognition

Age 24-34
Gender Male, 97.4%
Calm 96.5%
Angry 1.4%
Sad 0.6%
Happy 0.4%
Fear 0.4%
Disgusted 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 18-26
Gender Female, 100%
Angry 70.6%
Calm 16%
Confused 7.1%
Surprised 2.6%
Disgusted 1.4%
Sad 1.1%
Fear 0.7%
Happy 0.4%

AWS Rekognition

Age 4-12
Gender Male, 93.2%
Sad 57.7%
Calm 18.6%
Angry 8.8%
Fear 5.2%
Confused 4.3%
Happy 2%
Disgusted 1.7%
Surprised 1.6%

AWS Rekognition

Age 21-29
Gender Female, 90.8%
Angry 54.9%
Calm 38.5%
Sad 4.5%
Disgusted 0.6%
Surprised 0.5%
Confused 0.5%
Happy 0.4%
Fear 0.2%

AWS Rekognition

Age 6-16
Gender Male, 92.3%
Calm 61%
Fear 7.7%
Confused 7.7%
Surprised 6.1%
Sad 5.7%
Disgusted 4.5%
Angry 4%
Happy 3.3%

AWS Rekognition

Age 48-54
Gender Female, 82.6%
Calm 96.2%
Angry 1.7%
Sad 1.2%
Surprised 0.3%
Confused 0.2%
Disgusted 0.1%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 11-19
Gender Female, 74.7%
Calm 89.8%
Sad 5.7%
Angry 1.5%
Fear 1.3%
Confused 0.6%
Surprised 0.6%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 23-33
Gender Female, 64.6%
Sad 68.4%
Calm 7.3%
Happy 6.5%
Fear 6.4%
Angry 4.6%
Confused 2.8%
Disgusted 2.8%
Surprised 1.2%

AWS Rekognition

Age 18-24
Gender Male, 93%
Calm 49.3%
Angry 15.5%
Sad 9.4%
Fear 7.8%
Happy 6.6%
Disgusted 5.5%
Confused 3.1%
Surprised 2.9%

AWS Rekognition

Age 12-20
Gender Female, 95.6%
Calm 62.6%
Happy 12.5%
Sad 7.7%
Angry 6.2%
Disgusted 4.3%
Surprised 3.3%
Fear 1.9%
Confused 1.5%

AWS Rekognition

Age 6-12
Gender Male, 99.9%
Angry 37.1%
Happy 27.9%
Calm 19.7%
Sad 7.8%
Disgusted 3.6%
Confused 1.6%
Fear 1.5%
Surprised 0.7%

AWS Rekognition

Age 23-31
Gender Male, 95.5%
Happy 83.1%
Calm 11%
Sad 1.6%
Surprised 1.3%
Fear 1.3%
Angry 0.8%
Disgusted 0.7%
Confused 0.3%

AWS Rekognition

Age 13-21
Gender Female, 95.2%
Calm 59.4%
Angry 16.2%
Sad 12.9%
Happy 4.5%
Disgusted 2.9%
Surprised 1.6%
Fear 1.5%
Confused 1.1%

AWS Rekognition

Age 20-28
Gender Male, 91.2%
Calm 90%
Disgusted 2.8%
Sad 2.6%
Fear 1.3%
Angry 1.2%
Happy 1.1%
Surprised 0.9%
Confused 0.2%

AWS Rekognition

Age 11-19
Gender Female, 73.6%
Calm 86.4%
Angry 5.3%
Sad 4.6%
Disgusted 1.1%
Surprised 0.8%
Confused 0.7%
Happy 0.6%
Fear 0.6%

AWS Rekognition

Age 23-31
Gender Male, 91.5%
Calm 58.6%
Disgusted 15.6%
Surprised 9.7%
Angry 7.5%
Sad 4.6%
Confused 1.6%
Happy 1.5%
Fear 0.9%

Feature analysis

Amazon

Person 98.7%

Categories

Imagga

interior objects 94.4%
cars vehicles 2.6%
food drinks 1.9%

Text analysis

Amazon

JOIN
JOI
NEW
DEMAND
WE
-
JUM
RECOGA
PAIN
as
a
CWA
NATUR
JOIL
.
adidas
..
CON
IN
as con
WORKERS
مية . .
CONTIN
RELIEF
WE NATUR DEMAND - - NEW - ورا
con
CHI
SHINI
IN LICEN
La
OF
.. 1
BAY
SHIST
IT
REGARD
24418
AM
I W A
JOIS
LICEN
COFFEE
ZAIL
- FOR
TEMAS -
مية
- FLES
LEAGUE
IN NII
MEGAL
KIA ..
AND
LEAGEE
LIKE -
TAKA
EMPAR
EXI
CKO AM
WAN
СКАРА
LIKE
CO
SIMAN
KIA
GREAN
greal
IMA
.. . greal
EXI 2013
CHAPE
CHINI
TEMAS
... WAN
CMAAN
1
HAUS
FLES
Come
EMPIRE
Come Classic
HUI
Classic
CKO
رج
C.A.A
SWE
TO
CREA
...
2013
FOR
HAND
LEE
ورا
KOHL'S

Google

COU Rer CONTIN C ntw OI EEL CWA A ..
COU
Rer
CONTIN
C
ntw
OI
EEL
CWA
A
..