Human Generated Data

Title

[Hägg-Feininger Family in Stockholm, 1936]

Date

1940s-1950s

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.1003.125

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Hägg-Feininger Family in Stockholm, 1936]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1940s-1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clothing 99.7
Apparel 99.7
Person 99.7
Human 99.7
Person 99.6
Person 99.5
Coat 98.2
Overcoat 98.2
Suit 98.2
Hat 91.6
Furniture 88.3
Tuxedo 82.2
Chair 77.2
Face 69.7
Musician 65.1
Musical Instrument 65.1
Music Band 60.1
Racket 58.5
Tennis Racket 58.5
Accessories 56.4
Tie 56.4
Accessory 56.4
Brass Section 55.8
Horn 55.8
Sitting 55.7
Bench 55.2

Clarifai
created on 2019-11-16

people 99.9
group together 98.4
adult 98.3
group 98.2
man 96.1
wear 95.8
administration 95.7
woman 95.3
two 92.7
several 92.5
vehicle 92.2
leader 91.3
outfit 91.3
movie 89.1
many 88.5
music 88.4
three 87.9
four 87.6
recreation 85.5
facial expression 84.1

Imagga
created on 2019-11-16

brass 40.9
wind instrument 35.4
musical instrument 30.9
man 30.9
people 26.8
male 23.5
couple 20
silhouette 17.4
love 17.3
person 16.9
black 15.6
adult 15
happy 13.2
together 12.3
cornet 12.2
happiness 11.7
sunset 11.7
park 11.7
outdoor 11.5
men 11.2
lifestyle 10.8
sky 10.8
device 10.7
business 10.3
youth 10.2
two 10.2
family 9.8
summer 9.6
sport 9.3
relax 9.3
horn 9.2
leisure 9.1
portrait 9.1
lady 8.9
romantic 8.9
businessman 8.8
dusk 8.6
outdoors 8.5
relationship 8.4
attractive 8.4
child 8.3
holding 8.2
human 8.2
fun 8.2
group 8.1
women 7.9
sitting 7.7
kin 7.7
old 7.7
walking 7.6
friends 7.5
active 7.3
looking 7.2
holiday 7.2
romance 7.1
handsome 7.1
smile 7.1
day 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

clothing 97.5
person 97.1
text 92.2
man 89.9
window 86
old 83.2
musical instrument 79.2
drum 62.8
footwear 60.8
black and white 60.2

Face analysis

Amazon

Google

AWS Rekognition

Age 37-55
Gender Female, 89.6%
Angry 0.1%
Surprised 0.1%
Sad 0.2%
Happy 99.4%
Disgusted 0%
Confused 0%
Calm 0.2%
Fear 0%

AWS Rekognition

Age 31-47
Gender Male, 99.9%
Disgusted 7.2%
Sad 0.5%
Happy 1.8%
Surprised 0.1%
Calm 86.6%
Fear 0%
Confused 0.4%
Angry 3.3%

AWS Rekognition

Age 23-35
Gender Male, 92.1%
Calm 81.8%
Surprised 0.5%
Happy 2.2%
Sad 12.1%
Confused 0.8%
Angry 1.7%
Fear 0.4%
Disgusted 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Hat 91.6%

Captions

Microsoft

a group of people sitting in front of a window 89%
a group of people posing for a photo in front of a window 88.9%
a group of people sitting and standing in front of a window 88.8%