Human Generated Data

Title

Untitled (three young women posed with person in horse costume during graduation party)
Date

1961
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9770

Human Generated Data

Title

Untitled (three young women posed with person in horse costume during graduation party)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-24

Clothing 99.9
Apparel 99.9
Person 99.3
Human 99.3
Dress 99.1
Person 99.1
Person 99
Female 97.9
Skirt 96.9
Woman 93.7
Person 86.7
Shorts 75.5
Shoe 73.7
Footwear 73.7
Sleeve 71.3
People 64
Indoors 59.5
Room 59.5
Gown 57.3
Fashion 57.3
Robe 57.3
Evening Dress 57.3
Long Sleeve 56.7

Imagga
created on 2022-01-24

people 31.2
fashion 30.9
clothing 27.1
person 27
adult 25.3
smiling 23.9
lady 23.5
dress 22.6
attractive 22.4
shopping 22.1
happy 21.9
smile 21.4
women 20.6
bags 20.5
bag 20
happiness 18.8
pretty 18.2
portrait 17.5
clothes 16.9
sale 16.6
shop 15.9
holding 14.9
style 14.8
couple 14.8
cheerful 14.6
mall 14.6
store 14.2
standing 13.9
gift 13.8
customer 13.3
casual 12.7
elegance 12.6
buying 12.5
outfit 12.5
lifestyle 12.3
cute 12.2
looking 12
model 11.7
mother 11.7
shopper 11.6
business 11.5
shoes 11.5
face 11.4
sexy 11.2
man 10.8
holiday 10.8
together 10.5
human 10.5
group 10.5
one 10.5
walking 10.4
boutique 10.2
sibling 10.1
girls 10
joy 10
attendant 9.8
old 9.8
elegant 9.4
buy 9.4
winter 9.4
male 9.2
black 9.2
hand 9.1
children 9.1
child 9
family 8.9
posing 8.9
market 8.9
consumer 8.8
kin 8.7
fashionable 8.5
adults 8.5
friends 8.5
studio 8.4
positive 8.3
fun 8.2
present 8.2
coat 8.2
buyer 7.8
color 7.8
men 7.7
modern 7.7
gown 7.6
two 7.6
retail 7.6
room 7.4
blond 7.2
bride 7.1
jacket 7.1
lovely 7.1
parent 7.1
work 7.1

Google
created on 2022-01-24

One-piece garment 90.4
Black 89.5
Sleeve 87.2
Gesture 85.3
Style 83.9
Waist 81.3
Day dress 81
Fashion design 76.8
Art 75.7
Street fashion 75.2
Snapshot 74.3
Pattern 73
Vintage clothing 72.2
Knee 71.7
Monochrome photography 70.5
Monochrome 69.1
Stock photography 64.4
Visual arts 63
Room 62.6
Font 61.9

Microsoft
created on 2022-01-24

dress 98.7
wall 97.5
text 96.3
posing 88.8
clothing 88.4
standing 82.8
skirt 79.2
person 79.1
woman 78.6
footwear 74.7
smile 61.8

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 99.6%
Sad 48%
Disgusted 18.8%
Happy 7.7%
Confused 7.4%
Calm 7.1%
Fear 5.5%
Angry 3.2%
Surprised 2.5%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Happy 38.2%
Surprised 25.2%
Calm 20.4%
Fear 7%
Confused 2.9%
Sad 2.9%
Disgusted 2.8%
Angry 0.8%

AWS Rekognition

Age 30-40
Gender Female, 58.8%
Happy 45.5%
Surprised 23.3%
Sad 15.3%
Calm 8.4%
Confused 4%
Disgusted 1.8%
Fear 0.9%
Angry 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Skirt 96.9%
Shoe 73.7%

Captions

Microsoft

a person standing in front of a group of people posing for a photo 79.6%
a group of people posing for a photo 79.5%
a person standing in front of a group of people posing for the camera 79.4%

Text analysis

Amazon

a
2 4 8 a a
KODAK-A-ITW
2 4 8

Google

2
-
a
MJI7--
Y
T37A°2-
XAGO
t8
2 t8 a a MJI7-- Y T37A°2- - XAGO