Human Generated Data

Title

[Organ grinder with monkey and two women]
Date

early 1930s
People

Artist: Lyonel Feininger, American 1871 - 1956
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.291.17
Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Organ grinder with monkey and two women]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

early 1930s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-29

Person 99.6
Human 99.6
Person 99.3
Apparel 98.9
Clothing 98.9
Person 98.4
Hat 95.6
Person 93.6
Overcoat 83.6
Coat 83.6
Suit 83.6
Dress 83.4
Animal 70.8
Face 70.1
Outdoors 69
Mammal 67.1
Portrait 64.8
Photo 64.8
Photography 64.8
Fence 64.6
Nature 64.2
Yard 64.2
Pet 61.6
Female 61.2
Canine 60.6
Man 55.1

Clarifai
created on 2019-05-29

people 99.8
adult 99.3
man 97.5
woman 96.9
group 96.7
group together 95
two 94.4
wear 91.9
administration 90.5
war 88.8
interaction 85.8
several 84.5
music 83.4
leader 83.3
portrait 81.6
child 81.6
facial expression 81.5
three 78.1
veil 78.1
many 78

Imagga
created on 2019-05-29

man 33.6
people 29
male 28.4
outdoors 27.1
together 26.3
couple 26.1
person 22.3
love 22.1
happy 21.3
adult 21
outdoor 19.9
park 19.8
two 18.6
fun 17.9
summer 17.4
smile 15.7
smiling 15.2
women 15
leisure 14.9
device 14.4
family 14.2
attractive 14
child 13.7
lifestyle 13.7
active 13.6
happiness 13.3
portrait 12.3
face 12.1
spectator 12
binoculars 11.7
husband 11.6
boy 11.3
relationship 11.2
sport 11.1
outside 11.1
girls 10.9
photographer 10.8
married 10.5
forest 10.4
wife 10.4
hands 10.4
friends 10.3
senior 10.3
day 10.2
group 9.7
looking 9.6
optical instrument 9.5
grass 9.5
spring 9.4
hand 9.1
instrument 9
activity 9
lady 8.9
hair 8.7
girlfriend 8.7
sitting 8.6
marriage 8.5
expression 8.5
guy 8.5
casual 8.5
tree 8.5
father 8.4
friendship 8.4
joy 8.3
emotion 8.3
vacation 8.2
childhood 8.1
romance 8
cute 7.9
hug 7.7
loving 7.6
walk 7.6
human 7.5
mature 7.4
holding 7.4
playing 7.3
children 7.3
recreation 7.2
holiday 7.2
romantic 7.1
look 7

Google
created on 2019-05-29

Photograph 97.1
People 93.1
Snapshot 86.3
Black-and-white 85.4
Monochrome photography 82
Photography 81.3
Monochrome 75.8
Stock photography 70.9
Tree 68.7
Gesture 58.5
History 57.6
Family 51.8
Style 51

Microsoft
created on 2019-05-29

person 99.9
tree 99.8
outdoor 99.7
clothing 95.6
standing 94.3
black and white 84.8
man 70.5
woman 70.4
mammal 53
posing 43.3
crowd 1.3

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 9-14
Gender Female, 50.8%
Surprised 45.4%
Disgusted 45.4%
Angry 45.8%
Sad 48.1%
Confused 45.7%
Calm 49.4%
Happy 45.3%

AWS Rekognition

Age 35-55
Gender Male, 79.8%
Calm 72.1%
Sad 1.9%
Angry 2.2%
Confused 1.5%
Disgusted 0.9%
Surprised 21%
Happy 0.3%

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Hat 95.6%

Captions

Microsoft

a person standing in front of a group of people posing for the camera 92.5%
a person standing in front of a group of people posing for a picture 92.4%
a person standing in front of a group of people posing for a photo 90.4%