Human Generated Data

Title

[Shop window mannequins with ladies hats]

Date

1950s?

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.331.17

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Shop window mannequins with ladies hats]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1950s?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-29

Apparel 100
Clothing 100
Hat 99.9
Hat 99.2
Human 98.5
Person 98.5
Person 96.1
Person 95.8
Sun Hat 93.6
Hat 89.4
Person 88.3
Person 70.6
Person 68.6
Bonnet 64.1
Person 58.4

Clarifai
created on 2019-05-29

people 99.9
child 99
group 98.1
adult 97
group together 97
woman 95.7
wear 95.3
many 95.1
man 94.9
monochrome 94.4
several 94
sit 91.5
furniture 90.4
lid 90
indoors 88.8
four 87.1
veil 86.9
outfit 85.8
recreation 84.3
boy 82.6

Imagga
created on 2019-05-29

hat 100
cowboy hat 96.4
headdress 85.5
clothing 56.5
sombrero 48.1
consumer goods 28.8
covering 28.8
old 16.7
people 16.2
man 15.4
traditional 13.3
hand 12.1
male 12
shop 11.5
person 11.3
men 11.2
adult 11
holiday 10.7
retro 10.6
portrait 10.3
culture 10.2
life 10.1
smile 10
black 9.6
happy 9.4
child 9.2
travel 9.1
fashion 9
religion 9
market 8.9
cowboy 8.8
religious 8.4
vintage 8.3
human 8.2
history 8
light 8
urban 7.9
architecture 7.8
western 7.7
instrument 7.5
city 7.5
outdoors 7.5
sale 7.4
playing 7.3
smiling 7.2
music 7.2
art 7.2
celebration 7.2
face 7.1
happiness 7

Google
created on 2019-05-29

Microsoft
created on 2019-05-29

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-38
Gender Male, 59%
Happy 7.7%
Surprised 11.2%
Confused 17%
Angry 9.4%
Sad 9%
Calm 40.1%
Disgusted 5.7%

AWS Rekognition

Age 16-27
Gender Female, 96.7%
Happy 1.3%
Surprised 9%
Angry 13.9%
Disgusted 2.5%
Sad 6.4%
Confused 5.4%
Calm 61.6%

AWS Rekognition

Age 17-27
Gender Female, 98.2%
Disgusted 40.6%
Angry 5.3%
Calm 14.3%
Confused 4%
Sad 28.9%
Surprised 3%
Happy 3.8%

AWS Rekognition

Age 48-68
Gender Female, 52.1%
Confused 45.2%
Surprised 45.1%
Disgusted 45.1%
Calm 45.4%
Angry 45.3%
Happy 45.3%
Sad 53.6%

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 28
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.9%
Person 98.5%

Captions

Microsoft

a group of people sitting at a table in a restaurant 73%
a group of people in a restaurant 72.9%
a group of people sitting at a table 72.6%