Human Generated Data

Title

[Village boys]

Date

1930-1935

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.303.1

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Village boys]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1930-1935

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-29

Person 99.8
Human 99.8
Person 99.6
Person 98.1
Person 96.5
Person 94.4
People 92.2
Person 83.8
Face 82
Person 75.8
Clothing 72.9
Apparel 72.9
Person 70.3
Hair 66.5
Crowd 65.3
Family 65.2
Workshop 57.9
Head 55.9

Clarifai
created on 2019-05-29

people 99.9
group 99
adult 97.7
man 95.8
group together 95.2
administration 94.9
child 94.9
three 92.2
two 91.8
leader 91.4
several 91
portrait 89.8
woman 89.3
wear 89
war 88.8
four 87.6
vehicle 87.2
five 86.7
many 86.5
offspring 84.9

Imagga
created on 2019-05-29

grandfather 86.9
senior 75.9
couple 59.2
man 50.4
elderly 49.8
together 49.1
happy 48.3
grandma 44.9
male 44.4
mature 43.7
smiling 38.3
people 37.9
husband 36.3
retired 35.9
wife 35.1
love 33.9
family 32.9
old 32.7
retirement 32.7
person 30.8
mother 28.2
home 27.9
married 26.9
grandmother 26.4
child 26.4
portrait 25.9
adult 24.9
park 24.7
outdoors 23.1
lifestyle 23.1
sitting 22.3
smile 20.7
60s 19.5
70s 18.7
parent 18.6
affection 18.3
aged 18.1
laughing 18
loving 17.2
two 16.9
women 16.6
fun 16.5
happiness 16.5
active 16.2
sixties 15.7
older 15.5
relaxing 15.5
enjoying 15.2
father 15
camera 14.8
men 14.6
romance 14.3
relationship 14.1
friendship 14
pensioner 13.9
seniors 13.8
looking 13.6
affectionate 13.5
romantic 13.4
togetherness 13.2
cheerful 13
daughter 12.7
gray 12.6
indoors 12.3
middle aged 11.7
aging 11.5
marriage 11.4
relaxed 11.3
garden 10.9
horizontal 10.9
granddaughter 10.9
gray hair 10.8
son 10.6
health 10.4
casual 10.2
leisure 10
grandparents 9.9
two people 9.7
medical 9.7
kin 9.5
dad 9.5
friends 9.4
juvenile 9.4
glasses 9.3
holding 9.1
citizen 8.9
healthy 8.8
their 8.8
hug 8.7
day 8.6
attractive 8.4
joy 8.4
care 8.2
countryside 8.2
playing 8.2
80s 7.9
couples 7.8
boy 7.8
face 7.8
generation 7.7
illness 7.6
age 7.6
females 7.6
pair 7.6
enjoyment 7.5
close 7.4
lady 7.3
patient 7.3
group 7.3
hair 7.1
handsome 7.1
look 7

Google
created on 2019-05-29

Microsoft
created on 2019-05-29

person 99.6
human face 98.8
clothing 95
boy 90.3
old 73.9
toddler 64.9
baby 64.5
man 51.6
smile 51.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 9-14
Gender Male, 81.1%
Angry 11.1%
Disgusted 1.5%
Happy 2.2%
Sad 67.8%
Calm 13%
Surprised 1.4%
Confused 3%

AWS Rekognition

Age 10-15
Gender Male, 70.3%
Disgusted 3.5%
Sad 13.5%
Confused 2.4%
Happy 1.1%
Surprised 1.3%
Angry 70.7%
Calm 7.5%

AWS Rekognition

Age 6-13
Gender Male, 61.9%
Disgusted 4.1%
Happy 2.4%
Angry 43%
Calm 35.3%
Sad 11%
Confused 2.4%
Surprised 1.8%

Microsoft Cognitive Services

Age 6
Gender Male

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 6
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a group of people posing for a photo 94%
a group of people posing for the camera 93.9%
a group of people sitting posing for the camera 93.1%