Human Generated Data

Title

ERA March, Washington, DC (women in hard hats)

Date

1979

People

Artist: Rosalind Solomon, American born 1930

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Gift of the artist, 2.2002.927

Copyright

© Rosalind Fox Solomon. All rights reserved.

Human Generated Data

Title

ERA March, Washington, DC (women in hard hats)

People

Artist: Rosalind Solomon, American born 1930

Date

1979

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.7
Human 99.7
Person 99.7
Clothing 99.6
Apparel 99.6
Helmet 98.9
Person 98.8
Person 98.6
Person 96.3
Person 94.5
Hardhat 93.4
Sunglasses 92.8
Accessory 92.8
Accessories 92.8
Person 90.6
Sunglasses 90.5
Text 87.1
Person 86.5
Hat 82.6
Crowd 75.8
Word 69.8
Parade 60.5
Sunglasses 60.1
Protest 55.8
Person 51.6

Imagga
created on 2022-01-09

nurse 27.7
people 26.8
person 25.6
love 25.2
portrait 25.2
man 24.2
happy 21.9
couple 21.8
adult 21.4
bride 21.1
male 20
smile 19.9
happiness 18.8
smiling 17.4
wedding 16.5
clothing 16.3
old 15.3
looking 15.2
married 14.4
groom 14.3
cap 14
girls 13.7
human 13.5
mother 13.3
dress 12.6
family 12.5
senior 12.2
men 12
pretty 11.9
elderly 11.5
husband 11.4
together 11.4
one 11.2
attractive 11.2
women 11.1
bridal 10.7
face 10.6
marriage 10.4
sexy 10.4
headdress 10.4
wife 10.4
body 10.4
home 10.4
hair 10.3
model 10.1
blond 10.1
joy 10
care 9.9
fashion 9.8
lady 9.7
fun 9.7
ceremony 9.7
kin 9.7
females 9.5
hat 9.2
shower cap 9.2
life 9.1
health 9
cheerful 8.9
parent 8.9
veil 8.8
grandma 8.8
gown 8.8
celebration 8.8
lifestyle 8.7
day 8.6
holiday 8.6
bouquet 8.5
black 8.4
child 8.4
mature 8.4
camera 8.3
vintage 8.3
outdoors 8.2
handsome 8
world 7.7
affection 7.7
outside 7.7
loving 7.6
patient 7.6
joyful 7.3
gray 7.2
wet 7.2
romance 7.1

Google
created on 2022-01-09

Microsoft
created on 2022-01-09

text 98.6
clothing 97.5
person 94
human face 90.1
man 88.7
woman 88
hat 83.2
fashion accessory 83.1
posing 80.8
black and white 78.3
smile 76.2
handwriting 54.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-65
Gender Female, 76.1%
Calm 99.4%
Angry 0.2%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0%
Happy 0%

AWS Rekognition

Age 35-43
Gender Male, 97.7%
Happy 99%
Sad 0.3%
Calm 0.2%
Fear 0.2%
Surprised 0.1%
Angry 0.1%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 96.3%
Disgusted 1%
Angry 0.9%
Sad 0.7%
Surprised 0.4%
Confused 0.4%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 36-44
Gender Male, 99%
Calm 41.8%
Fear 16.4%
Angry 9.2%
Confused 9%
Surprised 8.5%
Disgusted 7.6%
Sad 4.8%
Happy 2.7%

Microsoft Cognitive Services

Age 50
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Helmet 98.9%
Sunglasses 92.8%
Hat 82.6%

Captions

Microsoft

a group of people posing for a photo 96.3%
a group of people posing for the camera 96.2%
a group of people posing for a picture 96.1%

Text analysis

Amazon

STOP
DISCRIMINATION
WOMEN
AGAINST WOMEN
AGAINST
N.A.
IS
U.I.W.,
U.I.W., of N.A.
S
ORALL
of
9

Google

RALL
RALL STOP DISCIMINATION AGANST WOMEN U.I.W. OF N.A.
AGANST
OF
WOMEN
U.I.W.
STOP
DISCIMINATION
N.A.