Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)
Date

December 1933-March 1934
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4242

Human Generated Data

Title

Untitled (Civil Works Administration demonstration, New York City)

People

Artist: Ben Shahn, American 1898 - 1969

Date

December 1933-March 1934

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4242

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Clothing 100
Apparel 100
Hat 98.9
Human 98.8
Person 98.8
Person 97.7
Person 96.9
Person 95.9
Person 92.8
Hat 91.9
Sun Hat 88
Person 86.8
Person 78.2
Person 75.9
Cowboy Hat 73.6
Person 73.6
Person 72.9
Person 66.7
Person 61.7
Sombrero 57.2
Person 56.7
Person 50.8
Person 47.1

Clarifai
created on 2023-10-25

people 99.8
adult 98.4
man 96.7
one 96.6
furniture 95
lid 95
street 94.1
group 92.5
two 92.4
wear 91.7
veil 91.2
portrait 89.6
woman 89.4
group together 89.2
boy 84.5
art 84.5
reclining 83.1
recreation 83.1
seat 82.2
three 81.5

Imagga
created on 2022-01-08

sidecar 31
conveyance 27.3
man 20.9
hat 20.3
cowboy hat 19.8
people 17.8
adult 17.5
male 17.3
person 17.2
happy 15.7
portrait 14.9
headdress 14.2
couple 13.1
black 12.8
women 12.6
love 12.6
clothing 12.6
fashion 12.1
relax 11.8
kin 10.9
relaxation 10.9
attractive 10.5
sitting 10.3
smile 10
leisure 10
one 9.7
body 9.6
happiness 9.4
lifestyle 9.4
covering 9.4
groom 9.2
child 8.8
sexy 8.8
hair 8.7
couch 8.7
two 8.5
outdoor 8.4
pretty 8.4
alone 8.2
lady 8.1
indoors 7.9
day 7.8
face 7.8
model 7.8
men 7.7
lonely 7.7
married 7.7
youth 7.7
world 7.6
resting 7.6
wife 7.6
lying 7.5
fun 7.5
outdoors 7.5
floor 7.4
calm 7.3
indoor 7.3
relaxing 7.3
smiling 7.2
chair 7.1
summer 7.1
work 7.1
travel 7

Google
created on 2022-01-08

Hat 89.3
Fedora 89
Sun hat 79.4
Font 78.9
Art 73.6
Cap 71.9
Monochrome 70.7
Room 68.8
Vintage clothing 68.3
Monochrome photography 68.2
Cowboy hat 64.3
Stock photography 63.9
Costume hat 62.5
History 62.3
Fashion accessory 61.5
Personal protective equipment 59.7
Visual arts 59.6
Building 56.5
Photographic paper 55.6
Team 54

Microsoft
created on 2022-01-08

indoor 92.8
hat 92.4
person 89.2
window 88.7
text 83.8
man 82.8
clothing 82.3
cowboy hat 65.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Disgusted 89.9%
Angry 2.8%
Surprised 1.8%
Happy 1.4%
Sad 1.2%
Calm 1.1%
Fear 1%
Confused 0.9%

AWS Rekognition

Age 20-28
Gender Female, 62.8%
Calm 93.1%
Angry 2%
Sad 1.1%
Fear 1%
Disgusted 0.7%
Confused 0.7%
Happy 0.7%
Surprised 0.7%

AWS Rekognition

Age 21-29
Gender Male, 99.5%
Calm 98.3%
Angry 1.1%
Disgusted 0.2%
Surprised 0.1%
Confused 0.1%
Sad 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 21-29
Gender Male, 84.6%
Calm 99.3%
Sad 0.2%
Confused 0.2%
Happy 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 21-29
Gender Male, 84.3%
Calm 90.3%
Sad 3.7%
Angry 2.8%
Fear 1.5%
Surprised 0.6%
Disgusted 0.5%
Happy 0.3%
Confused 0.3%

AWS Rekognition

Age 23-33
Gender Male, 78.3%
Angry 47.3%
Sad 23.8%
Calm 10.5%
Disgusted 9.6%
Surprised 3.3%
Confused 2.3%
Fear 2.1%
Happy 1.1%

AWS Rekognition

Age 22-30
Gender Female, 89.3%
Calm 77.4%
Fear 8.2%
Angry 6.7%
Sad 2.4%
Happy 2.2%
Surprised 1.3%
Confused 1%
Disgusted 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 98.9%
Person 98.8%

Categories

Imagga

food drinks 69.4%
paintings art 12.2%
interior objects 6.8%
events parties 5.6%
people portraits 3.3%
text visuals 1.1%

Text analysis

Amazon

CWA
-
THE
NL
.
- M
M
..
HAND
RELIEF
CWA KM
...
- -
NL WONN
... Win
Ticso - Educado -
МОСКА
IX
Win
LEAGE
JOIN
KM
BLOCO
SPAR
KIN
и
DEMALD
PERIND
WONN
TEMAS
CAT
PARK
CEN
AWT
251
REVAIN
DEL CAT
MIRLING
Educado
Ticso
Carpo
DEL

Google

W-- E. W .E
W--
.E
E.
W