Human Generated Data

Title

[Group shot of Feininger family]
Date

1948-1955
People

Artist: Lyonel Feininger, American 1871 - 1956
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.539.10
Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Group shot of Feininger family]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1948-1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-19

Person 98.2
Human 98.2
Person 98
Person 97.9
Sitting 97.2
Person 96.8
Person 96.8
Apparel 86.7
Clothing 86.7
Electronics 75.3
Monitor 75.3
Screen 75.3
LCD Screen 75.3
Display 75.3
Shirt 66.7
Couch 66.6
Furniture 66.6
Person 64.6
Coat 63.5
Person 63.1
Clinic 59.9
Overcoat 59.9
Finger 56.7
Sleeve 55.4

Clarifai
created on 2019-11-19

people 99.7
group 99.4
adult 99.3
group together 98.1
man 97.7
woman 97.1
room 95.3
furniture 94.7
wear 94
several 92.9
employee 89.5
education 88.8
medical practitioner 86.2
many 85.4
facial expression 84.6
war 83.4
leader 83.3
five 82.3
sit 82.1
indoors 81.5

Imagga
created on 2019-11-19

barbershop 98.8
shop 76.7
hairdresser 62.4
mercantile establishment 59.3
man 43.7
place of business 39.5
male 37.6
people 30.1
person 29.6
professional 25.8
medical 23
home 22.3
senior 21.6
adult 21.4
men 20.6
worker 20.6
indoors 20.2
sitting 19.8
establishment 19.7
work 19.6
room 19.6
office 19.3
occupation 18.3
table 18.2
business 17.6
patient 17.2
smiling 16.6
doctor 16
job 15.9
businessman 15.9
mature 15.8
couple 15.7
hospital 14.6
chair 14.4
working 13.3
happy 13.2
computer 12.8
health 12.5
elderly 12.5
happiness 11.8
salon 11.5
care 11.5
nurse 11.5
smile 11.4
women 11.1
interior 10.6
adults 10.4
desk 10.4
teacher 10.2
two 10.2
lifestyle 10.1
family 9.8
old 9.8
portrait 9.7
medicine 9.7
group 9.7
exam 9.6
study 9.3
board 9.1
color 8.9
together 8.8
retired 8.7
profession 8.6
clinic 8.6
illness 8.6
meeting 8.5
student 8.3
clothing 8.3
holding 8.3
confident 8.2
technology 8.2
cheerful 8.1
team 8.1
education 7.8
two people 7.8
couch 7.7
class 7.7
retirement 7.7
serious 7.6
talking 7.6
businesspeople 7.6
communication 7.6
classroom 7.4
phone 7.4
executive 7.4
inside 7.4
treatment 7.4
indoor 7.3
laptop 7.3
suit 7.2
looking 7.2
face 7.1
modern 7
specialist 7

Google
created on 2019-11-19

Photograph 95.7
Black-and-white 86.3
Snapshot 83.9
Monochrome photography 76.2
Monochrome 74.2
Room 65.7
Photography 62.4
Style 51

Microsoft
created on 2019-11-19

person 97.4
indoor 90
clothing 80.3
text 68.8
man 56

Face analysis

Amazon

AWS Rekognition

Age 28-44
Gender Male, 53.6%
Surprised 45%
Happy 45%
Disgusted 45%
Sad 45.4%
Calm 54.4%
Angry 45.1%
Fear 45%
Confused 45%

AWS Rekognition

Age 23-37
Gender Male, 53.9%
Happy 45.3%
Confused 45.1%
Sad 45.5%
Calm 54.1%
Angry 45%
Fear 45%
Surprised 45.1%
Disgusted 45%

AWS Rekognition

Age 32-48
Gender Male, 50.8%
Calm 46.3%
Angry 50.5%
Surprised 45.5%
Disgusted 45.1%
Fear 45.9%
Sad 45.9%
Confused 45.2%
Happy 45.5%

AWS Rekognition

Age 43-61
Gender Female, 50.1%
Confused 45.2%
Fear 45.4%
Angry 46.6%
Sad 49.9%
Happy 45.1%
Surprised 45.2%
Disgusted 45.1%
Calm 47.4%

Feature analysis

Amazon

Person 98.2%

Captions

Microsoft

a group of people standing around a table 89.6%
a group of people in a room 89.5%
a group of people standing in a room 89.4%