Human Generated Data

Title

[Lyonel and Lux Feininger]
Date

1931?
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.289.19

Human Generated Data

Title

[Lyonel and Lux Feininger]

People

Artist: Unidentified Artist,

Date

1931?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-19

Apparel 99.8
Clothing 99.8
Person 99.1
Human 99.1
Person 98.8
Overcoat 91.3
Suit 91.3
Coat 91.3
Robe 86.2
Fashion 86.2
Wedding 83
Tie 82.6
Accessories 82.6
Accessory 82.6
Gown 81.4
Bridegroom 75.7
Tuxedo 75.4
Wedding Gown 73.2
Face 63.3
Female 62.7
Military Uniform 60.7
Military 60.7
Officer 60.7
Finger 58.9
Furniture 58.9
Couch 58.9
Bride 57.8
Sitting 57.4

Clarifai
created on 2019-11-19

people 99.9
portrait 99
adult 98.9
two 98.5
man 98.4
wear 96.1
leader 94.9
administration 94.1
one 93.7
music 93.5
group 93.3
outfit 92.8
three 92.3
facial expression 91.7
actor 88.9
movie 84.8
musician 84.5
woman 84
sit 83.5
group together 82.8

Imagga
created on 2019-11-19

bow tie 100
necktie 93
man 53.1
garment 46.6
male 41.2
people 30.1
couple 27.9
adult 27.2
suit 26.7
clothing 26.1
happy 25.1
businessman 23.8
business 22.5
handsome 22.3
person 21.9
men 21.5
portrait 21.4
together 21
love 19.7
happiness 18.8
family 18.7
attractive 18.2
smiling 18.1
grandfather 16.7
executive 16.6
smile 16.4
married 16.3
meeting 16
waiter 15.8
sitting 15.5
group 15.3
employee 15.3
office 15.3
professional 15.2
father 14.1
corporate 12.9
worker 12.4
lifestyle 12.3
success 12.1
home 12
expression 11.9
dining-room attendant 11.9
casual 11.9
dress 11.7
holding 11.6
cheerful 11.4
face 11.4
team 10.7
romantic 10.7
husband 10.6
tie 10.4
relationship 10.3
businessmen 9.8
fun 9.7
black 9.6
formal 9.6
serious 9.5
cute 9.3
two 9.3
mature 9.3
teamwork 9.3
confident 9.1
businesswoman 9.1
fashion 9
child 9
lady 8.9
indoors 8.8
couch 8.7
women 8.7
guy 8.7
boyfriend 8.7
work 8.6
wife 8.5
friends 8.5
senior 8.4
old 8.4
hand 8.4
human 8.2
room 8.2
romance 8
job 8
hair 7.9
day 7.8
son 7.8
partner 7.7
girlfriend 7.7
pretty 7.7
diversity 7.7
partnership 7.7
sofa 7.7
boss 7.6
businesspeople 7.6
enjoying 7.6
togetherness 7.6
horizontal 7.5
joy 7.5
looking 7.2
dad 7.2
building 7.1
game 7.1

Google
created on 2019-11-19

Photograph 96.3
Black 94.8
Monochrome 88.3
Gentleman 87.6
Black-and-white 86.3
Snapshot 82.5
Monochrome photography 82
Human 74.7
Film noir 72.1
Photography 70.6
Movie 57.4
Style 55
Suit 53.3

Microsoft
created on 2019-11-19

person 99.8
human face 98.8
man 97.6
clothing 97.3
smile 97.1
black and white 85.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 42-60
Gender Male, 85.2%
Fear 1.4%
Angry 1.1%
Surprised 0.2%
Happy 0.6%
Confused 1%
Disgusted 8.1%
Calm 3%
Sad 84.5%

AWS Rekognition

Age 33-49
Gender Female, 84.4%
Sad 7.9%
Calm 0.1%
Angry 1.5%
Disgusted 0.3%
Fear 85%
Surprised 0.3%
Happy 4.7%
Confused 0.2%

Microsoft Cognitive Services

Age 60
Gender Male

Microsoft Cognitive Services

Age 34
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Suit 91.3%
Tie 82.6%

Captions

Microsoft

a man wearing a suit and tie 97.2%
a man in a suit and tie 97.1%
a man wearing a suit and tie holding a gun 90.5%