Human Generated Data

Title

Untitled [Snapshot of Julia Feininger with Lawrence and Andreas Feininger]

Date

c. 8/6/1909

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of Julia Feininger, BR63.5456

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

Untitled [Snapshot of Julia Feininger with Lawrence and Andreas Feininger]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

c. 8/6/1909

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Furniture 100
Person 97.7
Human 97.7
Crib 94.4
Person 93.7
Painting 84.1
Art 84.1
Cradle 76.4

Imagga
created on 2022-03-05

cradle 67.6
baby bed 62
furniture 49.4
child 49.4
family 44.5
furnishing 32.3
happy 29.5
love 29.2
kin 27.6
mother 27.5
kid 27.5
children 27.3
male 25.7
people 25.7
couple 25.3
happiness 25.1
smiling 24.6
together 23.7
little 23
cute 22.2
sibling 22.1
man 21.5
parent 21.4
fun 21
childhood 20.6
portrait 20.1
husband 20
cheerful 19.5
father 18.9
baby 18.4
two 17.8
boy 17.4
lifestyle 17.3
daughter 17.2
adult 16.2
home 16
playing 15.5
shopping cart 15.2
adorable 14.8
girls 14.6
loving 14.3
wife 14.2
person 13.8
sitting 13.7
face 13.5
son 13.4
joy 13.4
handcart 12.4
park 12.4
youth 11.9
mom 11.6
leisure 11.6
toddler 11.5
enjoying 11.4
laughing 11.3
togetherness 11.3
smile 10.7
outdoors 10.5
kids 10.4
casual 10.2
indoor 10
care 9.9
attractive 9.8
affectionate 9.7
summer 9.6
black 9.6
play 9.5
senior 9.4
chair 9.3
holiday 9.3
holding 9.1
life 8.7
married 8.6
outside 8.6
wheeled vehicle 8.6
relaxed 8.4
pretty 8.4
old 8.4
shopping 8.3
healthy 8.2
dad 8.2
looking 8
indoors 7.9
parenthood 7.8
hug 7.7
crib 7.7
pair 7.6
enjoy 7.5
enjoyment 7.5
one 7.5
container 7.4
blond 7.4
hold 7.4
relaxing 7.3
dress 7.2
rocking chair 7.1
day 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 99.3
baby 97.8
toddler 95.5
human face 93.6
indoor 87.1
clothing 86.6
child 81.6
white 77.1
old 76.9
black 66.6
smile 54.5
posing 46.5
dressed 36.6
net 30.9
clothes 29.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 2-8
Gender Male, 99.6%
Calm 99.8%
Surprised 0.1%
Sad 0%
Confused 0%
Happy 0%
Angry 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Female, 100%
Calm 88.5%
Angry 3.6%
Happy 1.7%
Sad 1.7%
Fear 1.6%
Surprised 1.1%
Disgusted 1.1%
Confused 0.7%

AWS Rekognition

Age 0-3
Gender Male, 85.8%
Surprised 37%
Calm 21.8%
Happy 17.2%
Angry 7.8%
Fear 6.6%
Confused 3.5%
Disgusted 3.4%
Sad 2.7%

Microsoft Cognitive Services

Age 19
Gender Female

Microsoft Cognitive Services

Age 32
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Painting 84.1%

Captions

Microsoft

a vintage photo of a little girl posing for a picture 77.2%
a vintage photo of a boy 77.1%
a vintage photo of a person 77%