Human Generated Data

Title

[Julia and Tomas Feininger]

Date

1940-1945

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.437.11

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Julia and Tomas Feininger]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1940-1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-13

Human 99.5
Person 99.5
Head 96.8
Face 95.7
Person 95.4
Clothing 95.2
Overcoat 95.2
Suit 95.2
Coat 95.2
Apparel 95.2
Portrait 70.1
Photography 70.1
Photo 70.1
Text 68.9
Art 60.4
Man 59.8
Painting 58.6
Tuxedo 56.3
Senior Citizen 55.6
Performer 55.1

Imagga
created on 2021-12-13

man 47.1
senior 44.1
male 41.2
grandfather 38.3
people 36.8
couple 34
old 32.7
portrait 29.1
hairdresser 29.1
person 28.7
elderly 26.8
happy 26.3
wife 23.7
adult 23.4
retired 23.3
husband 22.9
love 22.9
face 20.6
retirement 20.2
mature 19.5
together 19.3
gray 18
grandmother 17.6
hair 17.4
married 17.3
men 17.2
lifestyle 16.6
smile 15.7
smiling 14.5
looking 14.4
family 14.2
grandma 13.4
home 12.8
black 12.7
romance 12.5
handsome 12.5
marriage 12.4
lady 12.2
hand 12.2
glasses 12
human 12
happiness 11.8
age 11.4
wig 11.4
look 11.4
beard 10.9
affection 10.6
cheerful 10.6
eyes 10.3
two 10.2
head 10.1
pensioner 9.8
women 9.5
father 9.5
expression 9.4
painter 9.4
aged 9
fun 9
romantic 8.9
to 8.9
indoors 8.8
older 8.7
loving 8.6
togetherness 8.5
child 8.5
relationship 8.4
hairpiece 8.4
holding 8.3
one 8.2
active 8.1
blond 8.1
success 8
holiday 7.9
elder 7.9
maturity 7.9
affectionate 7.7
aging 7.7
enjoying 7.6
attire 7.5
clothing 7

Google
created on 2021-12-13

Microsoft
created on 2021-12-13

person 94.4
text 92.4
human face 92.4
indoor 90.2
black and white 85.4
clothing 84.6
man 82.3
screenshot 65.4

Face analysis

Amazon

Google

AWS Rekognition

Age 23-35
Gender Female, 53.2%
Calm 53.6%
Sad 12.1%
Happy 11.8%
Surprised 9.5%
Fear 5.6%
Confused 3.7%
Angry 2.8%
Disgusted 0.9%

AWS Rekognition

Age 49-67
Gender Male, 98.4%
Calm 98.8%
Sad 0.6%
Happy 0.3%
Surprised 0.1%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Painting 58.6%

Captions

Microsoft

a person standing in front of a window 74.4%
a man and a woman standing in front of a window 48.4%
a person standing in front of a mirror 48.3%