Human Generated Data

Title

[Lyonel Feininger]

Date

Late 1940's

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.501.2

Human Generated Data

Title

[Lyonel Feininger]

People

Artist: Unidentified Artist,

Date

Late 1940's

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-05

Person 99.6
Human 99.6
Person 99.5
Overcoat 95.7
Clothing 95.7
Apparel 95.7
Suit 95.7
Coat 95.7
Sitting 84.8
Face 84.8
Nature 72.7
Accessories 72
Tie 72
Accessory 72
Finger 69.8
Food 68.5
Meal 68.5
Plant 67.4
Outdoors 65.8
Dish 63.9
Man 58
Text 57.5

Clarifai
created on 2021-04-05

people 99.7
man 98
adult 97.8
one 97.5
administration 96
portrait 96
leader 95.9
monochrome 91.7
two 88.6
wear 86.3
actor 86.2
group 84
outfit 81.1
music 80.2
chair 79
group together 78.5
three 75.3
politician 74.4
street 73.8
sit 69.3

Imagga
created on 2021-04-05

man 46.4
person 41.9
portrait 38.2
male 38
handsome 34.8
people 32.9
happy 28.2
adult 27.2
businessman 26.5
smiling 25.3
suit 25.1
smile 24.2
senior 21.6
business 20.7
scholar 20.2
face 19.9
old 19.5
looking 19.2
executive 17.9
professional 17.9
grandfather 17.9
mature 17.7
retired 17.5
outdoors 17.3
elderly 17.2
tie 17.1
world 16.8
attractive 16.8
intellectual 16.2
lifestyle 15.9
standing 15.7
confident 15.5
office 15.3
corporate 14.6
love 14.2
shirt 14
couple 13.9
outside 13.7
groom 13.6
work 13.4
men 12.9
casual 12.7
hair 12.7
guy 12.7
successful 11.9
retirement 11.5
serious 11.4
sexy 11.3
one 11.2
outdoor 10.7
success 10.5
parent 10.3
manager 10.2
black 10.2
mother 10.2
friendly 10.1
grandma 9.8
cheerful 9.8
husband 9.7
head 9.2
gray 9
together 8.8
sitting 8.6
close 8.6
model 8.6
marriage 8.6
joy 8.4
alone 8.2
job 8
father 7.9
day 7.9
happiness 7.8
thoughtful 7.8
modern 7.7
pretty 7.7
expression 7.7
married 7.7
laughing 7.6
communication 7.6
smart 7.5
relaxed 7.5
park 7.4
glasses 7.4
lady 7.3
relaxing 7.3
stylish 7.2

Google
created on 2021-04-05

Microsoft
created on 2021-04-05

man 99.6
person 99.3
human face 97.7
text 92.8
clothing 92.5
suit 82.8
wearing 75.2
smile 73.2
posing 53.5
old 50.1
older 22.2

Face analysis

Amazon

Google

AWS Rekognition

Age 51-69
Gender Male, 87.3%
Calm 89.7%
Sad 3.3%
Happy 2.9%
Confused 2.8%
Surprised 0.7%
Angry 0.3%
Fear 0.2%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Suit 95.7%
Tie 72%

Captions

Microsoft

a man wearing a suit and tie 99.2%
a man wearing a suit and tie smiling at the camera 98.6%
a man wearing a suit and tie posing for a photo 98.5%