Human Generated Data

Title

[Andreas and Julia Feininger paddling rowboat]

Date

1931?

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.289.17

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Andreas and Julia Feininger paddling rowboat]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1931?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-19

Human 99.6
Person 99.6
Clothing 99.3
Apparel 99.3
Person 97.6
Water 97.6
Face 95
Shorts 93.6
Outdoors 90
Dress 87.8
Nature 85.1
Female 84.1
Hug 81
Sleeve 78.3
Waterfront 76
Sea 71.2
Ocean 71.2
Port 68.9
Dock 68.9
Pier 68.9
Smile 64.9
Woman 64.7
Long Sleeve 64
Leisure Activities 61.6
Girl 60.6
Man 60.1
Photography 58
Photo 58
Transportation 57.3
Mouth 57
Lip 57
Teeth 57
Vehicle 56.6
Plant 56.3
Life Buoy 55.8

Clarifai
created on 2019-11-19

people 99.9
adult 99.5
one 98.9
two 97.8
portrait 97.6
woman 97.1
facial expression 95.4
wear 94.2
vehicle 93.4
watercraft 92.3
man 92.2
water 91.6
actress 90.6
recreation 90.5
summer 89.5
sit 86.8
music 86.2
reclining 82.9
sitting 81.2
girl 77.5

Imagga
created on 2019-11-19

water 27.4
beach 27
outdoors 26.5
person 25.2
summer 25.1
adult 24.1
attractive 23.8
people 23.4
happy 23.2
lifestyle 23.1
portrait 22.7
sea 21.9
pretty 21
mother 20.7
lake 20.6
child 19.7
happiness 18.8
sexy 18.5
parent 18.4
leisure 18.3
world 18.3
outside 18
male 17.3
man 16.8
vacation 16.4
outdoor 16.1
fashion 15.1
couple 14.8
dress 14.5
river 14.2
fun 14.2
bikini 14
smiling 13.7
love 13.4
relaxation 13.4
healthy 13.2
lady 13
daughter 12.6
rustic 12.6
model 12.4
park 12.4
smile 12.1
sensuality 11.8
joy 11.7
active 11.7
ocean 11.6
cute 11.5
face 11.4
body 11.2
day 11
gorgeous 10.9
grandma 10.5
sun 10.5
brunette 10.5
vacations 10.4
enjoyment 10.3
sitting 10.3
hair 10.3
activity 9.9
family 9.8
cheerful 9.8
together 9.6
clothing 9.4
sibling 9.4
casual 9.3
two 9.3
holiday 9.3
20s 9.2
holding 9.1
childhood 9
handsome 8.9
kid 8.9
looking 8.8
women 8.7
natural 8.7
blond 8.7
fishing 8.7
expression 8.5
youth 8.5
tropical 8.5
one person 8.5
color 8.3
son 8.3
human 8.2
exotic 8.2
relaxing 8.2
posing 8
grass 7.9
summertime 7.7
bride 7.7
shore 7.6
marriage 7.6
fashionable 7.6
swimsuit 7.4
emotion 7.4
wedding 7.4
girls 7.3
children 7.3
sunset 7.2
coast 7.2
little 7.1

Google
created on 2019-11-19

Microsoft
created on 2019-11-19

person 99.6
water 97.3
outdoor 96.5
lake 92.5
clothing 92.2
human face 74.8
black and white 74.4
smile 74.4
woman 72.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 33-49
Gender Male, 98.3%
Confused 0%
Happy 99.9%
Fear 0%
Angry 0%
Sad 0%
Disgusted 0%
Surprised 0%
Calm 0.1%

AWS Rekognition

Age 34-50
Gender Female, 53.7%
Happy 3.8%
Fear 1.5%
Surprised 1.2%
Confused 13%
Angry 60.2%
Sad 4.7%
Disgusted 3%
Calm 12.6%

Microsoft Cognitive Services

Age 48
Gender Male

Microsoft Cognitive Services

Age 44
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a man and woman sitting next to a body of water 88.4%
a man and a woman sitting next to a body of water 88.3%
a man and a woman sitting in front of a body of water 87.5%