Human Generated Data

Title

[Lyonel Feininger with Galka Scheyer at her house in Hollywood, California]
Date

1936
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.142.1

Human Generated Data

Title

[Lyonel Feininger with Galka Scheyer at her house in Hollywood, California]

People

Artist: Unidentified Artist,

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-04

Human 97.5
Flooring 95.1
Sitting 94.9
Person 93.7
Person 90
Musician 84.4
Musical Instrument 84.4
Furniture 83.5
Chair 83.5
Floor 70.3
Interior Design 69.4
Indoors 69.4
Person 69.4
Performer 66.6
Leisure Activities 65.9
Flower 60.2
Plant 60.2
Blossom 60.2
Guitar 58.7
Guitarist 58.7
Cafe 56.1
Restaurant 56.1
Room 55.3
Living Room 55.3

Clarifai
created on 2021-04-04

people 99.8
man 96.9
adult 96.3
one 94.3
furniture 92.9
monochrome 92.6
room 91.8
art 91.7
music 91.6
musician 91.2
piano 90.8
group 89.5
portrait 89.5
indoors 88.9
chair 86
leader 85.8
woman 84.9
two 84.2
seat 82.6
three 81.2

Imagga
created on 2021-04-04

man 30.2
room 27.5
person 24.8
people 22.9
office 22.1
business 21.9
male 20.6
adult 19.1
chair 19.1
table 17.9
laptop 17.7
indoors 17.6
businessman 16.8
classroom 15.6
computer 15.4
black 15
work 14.9
modern 13.3
television 13.3
sitting 12.9
desk 12.6
home 12
teacher 11.9
stringed instrument 11.7
lifestyle 11.6
musical instrument 11.5
job 11.5
interior 11.5
couple 11.3
executive 11.3
love 11
back 11
worker 10.8
world 10.7
happy 10.7
boy 10.4
meeting 10.4
window 10.3
corporate 10.3
men 10.3
indoor 10
light 10
professional 10
piano 9.9
portrait 9.7
looking 9.6
furniture 9.3
glass 9.3
smile 9.3
dark 9.2
technology 8.9
working 8.8
women 8.7
couch 8.7
career 8.5
phone 8.3
human 8.2
child 8.2
suit 8.2
businesswoman 8.2
dress 8.1
music 8.1
group 8.1
smiling 8
percussion instrument 7.9
grand piano 7.9
blackboard 7.9
face 7.8
model 7.8
communication 7.6
telephone 7.5
relaxation 7.5
house 7.5
future 7.4
holding 7.4
student 7.4
board 7.3
success 7.2
body 7.2
art 7.2
telecommunication system 7.1
device 7.1
happiness 7.1

Google
created on 2021-04-04

Photograph 94.2
Black 89.7
Black-and-white 84.3
Style 83.8
Font 81.2
Plant 81.1
Art 79.6
Tints and shades 76.3
Snapshot 74.3
Monochrome photography 73.2
Monochrome 72.5
Rectangle 71.2
Chair 71.2
Event 69.4
Visual arts 69.2
Room 66.5
Stock photography 64.8
Sitting 56.8
Still life photography 55.8
History 55.3

Microsoft
created on 2021-04-04

text 99
black and white 92.1
indoor 88.3
person 75.1
drawing 72.2
furniture 70.6
clothing 70.3
man 50.9

Face analysis

Amazon

AWS Rekognition

Age 41-59
Gender Male, 71.5%
Sad 69.8%
Calm 20.8%
Happy 5.4%
Fear 2%
Confused 0.8%
Angry 0.6%
Surprised 0.4%
Disgusted 0.2%

AWS Rekognition

Age 26-42
Gender Female, 61.1%
Calm 76.2%
Sad 9.6%
Happy 3.9%
Confused 3.7%
Surprised 2.7%
Angry 2.7%
Fear 0.6%
Disgusted 0.5%

Feature analysis

Amazon

Person 93.7%

Captions

Microsoft

a group of people standing in a room 73.1%
a group of people in a room 73%
a group of people standing in front of a mirror 32.2%