Human Generated Data

Title

[Lyonel Feininger and Galka Scheyer at her house in Hollywood, California]

Date

1936

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.142.9

Human Generated Data

Title

[Lyonel Feininger and Galka Scheyer at her house in Hollywood, California]

People

Artist: Unidentified Artist,

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-04

Person 98.9
Human 98.9
Person 97
Chair 95.8
Furniture 95.8
Interior Design 93
Indoors 93
Flooring 80.1
Room 80
Musician 79.6
Musical Instrument 79.6
Crowd 69.8
Silhouette 67.8
Sitting 66.3
Leisure Activities 62.8
Text 61.7
Audience 61.4
Living Room 61.3
School 56.4
Classroom 56.4
Couch 56.1
Piano 56
Performer 56
Pianist 56

Clarifai
created on 2021-04-04

people 99.8
music 98.2
piano 96.7
man 96.6
musician 96.4
one 93.9
adult 92.8
guitar 91.8
monochrome 91
art 90.7
jazz 89.9
room 88.6
instrument 86.2
portrait 85.9
singer 85.5
group 85
pianist 84.6
concert 84.4
performance 83.1
stringed instrument 80.8

Imagga
created on 2021-04-04

classroom 90.1
room 86.2
office 31.8
business 31
man 29.6
computer 29.3
work 27.5
laptop 26.7
chair 26.5
person 26.2
male 25.5
people 24.6
adult 24.2
indoors 22.9
table 21.9
desk 21.9
modern 21.7
interior 21.2
businessman 21.2
corporate 20.6
professional 19.6
sitting 18
teacher 17.9
musical instrument 16.5
executive 16.4
worker 16
job 15.9
working 15.9
technology 15.6
indoor 15.5
businesswoman 14.5
happy 14.4
home 14.4
education 13.9
group 13.7
communication 13.4
meeting 13.2
success 12.9
looking 12.8
smiling 12.3
percussion instrument 11.9
women 11.9
house 11.7
employee 11.5
businesspeople 11.4
furniture 11.2
student 11
window 11
stringed instrument 10.9
suit 10.8
smile 10.7
blackboard 10.7
center 10.5
career 10.4
men 10.3
glass 10.1
light 10
confident 10
speaker 9.8
cheerful 9.8
corporation 9.6
happiness 9.4
lifestyle 9.4
device 9.4
mature 9.3
phone 9.2
one 9
class 8.7
floor 8.4
successful 8.2
board 8.1
lady 8.1
team 8.1
television 7.9
building 7.8
conference 7.8
architecture 7.8
black 7.8
portrait 7.8
kettle 7.7
break 7.6
monitor 7.6
workplace 7.6
talking 7.6
hand 7.6
relax 7.6
relaxation 7.5
senior 7.5
study 7.5
holding 7.4
teamwork 7.4
inside 7.4
design 7.3
handsome 7.1
day 7.1

Google
created on 2021-04-04

Microsoft
created on 2021-04-04

black and white 96.4
indoor 90.9
furniture 78.7
person 76.1
computer 70.4
monochrome 66.9
text 65
man 58.3
chair 53.7

Face analysis

Amazon

Google

AWS Rekognition

Age 36-54
Gender Male, 65.7%
Happy 60.2%
Calm 29.4%
Sad 6.1%
Angry 1.8%
Surprised 0.7%
Confused 0.7%
Fear 0.6%
Disgusted 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a group of people standing in a room 89.4%
a group of people in a room 89.3%
a man and a woman standing in a room 80%