Human Generated Data

Title

[Gerhard Marcks, New York]

Date

1950

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.355.15

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Gerhard Marcks, New York]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-29

Person 99.8
Human 99.8
Person 99.1
Clothing 98.4
Apparel 98.4
Coat 85.4
Overcoat 85.4
Suit 77
Face 67.5
Railing 64.9
Handrail 62.3
Banister 62.3
Photography 61
Portrait 61
Photo 61

Clarifai
created on 2019-05-29

people 99.9
adult 99.2
leader 98.2
administration 97.9
man 97.6
two 97.2
group 94.8
one 93.2
vehicle 92.9
group together 89.7
wear 88.6
portrait 85.8
transportation system 85.7
woman 84.9
chair 84.5
outfit 83.6
three 83.5
watercraft 83.3
music 80.3
facial expression 79.8

Imagga
created on 2019-05-29

groom 41.5
person 27.2
man 26.2
people 25.7
male 24.5
sky 19.4
adult 18.8
senior 18.7
business 17.6
building 16
old 15.3
lifestyle 15.2
happy 15
sitting 14.6
casual 14.4
architecture 14.2
construction 13.7
portrait 13.6
elderly 13.4
couple 13.1
work 12.7
mature 12.1
outdoors 11.9
newspaper 11.8
city 11.6
businessman 11.5
love 11
smiling 10.8
outdoor 10.7
structure 10.6
human 10.5
one 10.4
office 10.4
happiness 10.2
parent 10.1
equipment 10.1
worker 10
gray 9.9
pretty 9.8
technology 9.6
dad 9.6
men 9.4
father 9.4
two 9.3
smile 9.3
product 9.2
black 9
lady 8.9
engineer 8.9
job 8.8
looking 8.8
urban 8.7
retired 8.7
retirement 8.6
day 8.6
scholar 8.6
professional 8.4
modern 8.4
summer 8.4
vacation 8.2
world 8.1
handsome 8
life 7.9
park 7.8
industry 7.7
husband 7.6
serious 7.6
engineering 7.6
wife 7.6
manager 7.4
water 7.3
new 7.3
holiday 7.2
tower 7.2
hair 7.1
face 7.1
creation 7.1
steel 7.1
builder 7.1
sea 7
mother 7
together 7

Google
created on 2019-05-29

Microsoft
created on 2019-05-29

person 99.3
man 97
black and white 88.1
clothing 80.1
suit 75.4
old 51.5

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Female, 67.9%
Angry 11.1%
Sad 19.4%
Disgusted 21.2%
Happy 10.8%
Confused 16.5%
Surprised 12.1%
Calm 9.1%

AWS Rekognition

Age 30-47
Gender Male, 86.6%
Sad 1.4%
Angry 0.8%
Disgusted 0.2%
Calm 95.8%
Confused 0.5%
Surprised 0.4%
Happy 0.9%

Microsoft Cognitive Services

Age 54
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%

Captions

Microsoft

a man wearing a suit and tie 98.7%
a man in a suit and tie 98.6%
an old photo of a man in a suit and tie 98.1%