Human Generated Data

Title

[Lyonel Feininger at Galka Scheyer's house, Hollywood, California]

Date

1936

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.142.28

Human Generated Data

Title

[Lyonel Feininger at Galka Scheyer's house, Hollywood, California]

People

Artist: Unidentified Artist,

Date

1936

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-04

Person 98.9
Human 98.9
Furniture 95.8
Shelf 91.3
Home Decor 79.1
Cabinet 77.4
Shop 61.4
Closet 60
Cupboard 60
Face 59.2
Living Room 57.2
Room 57.2
Indoors 57.2

Clarifai
created on 2021-04-04

people 99.7
monochrome 99.1
adult 98.7
one 98.5
window 97.5
wear 95.3
street 95.3
man 94.5
administration 93.7
portrait 93.3
two 92.7
vehicle window 90.6
art 89.7
vehicle 88.1
indoors 87.2
room 84.1
leader 83.7
furniture 83.4
elderly 82.4
music 81

Imagga
created on 2021-04-04

barbershop 48.1
shop 44
grandma 35.8
mercantile establishment 34.1
senior 28.1
people 27.3
man 26.2
old 25.8
place of business 22.7
male 22
happy 21.3
person 21.1
portrait 17.5
elderly 17.2
home 16.7
outdoors 16.4
grandfather 16
retirement 15.4
mature 14.9
couple 14.8
retired 14.5
adult 14.2
smile 13.5
hair 13.5
love 13.4
together 13.1
smiling 13
lifestyle 13
men 12.9
establishment 12
sitting 12
happiness 11
grandmother 10.8
family 10.7
seller 10.5
wife 10.4
hairdresser 10.4
gray 9.9
lady 9.7
window 9.6
husband 9.5
house 9.2
life 9.2
aged 9
one 9
looking 8.8
glass 8.6
outside 8.6
city 8.3
building 8.3
street 8.3
vintage 8.3
black 7.8
mother 7.8
affection 7.7
pretty 7.7
married 7.7
casual 7.6
age 7.6
camera 7.4
business 7.3
face 7.1
indoors 7
architecture 7

Google
created on 2021-04-04

Microsoft
created on 2021-04-04

person 93.8
black and white 93.6
text 90
clothing 87.7
indoor 87.1
window 82.3
man 78.2
monochrome 72.1
human face 71.6
street 51.3
old 47.5
shop 8

Face analysis

Amazon

Google

AWS Rekognition

Age 44-62
Gender Male, 84.4%
Calm 67.4%
Sad 25.9%
Confused 3.6%
Happy 1.4%
Surprised 0.6%
Angry 0.5%
Fear 0.4%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.9%

Captions

Microsoft

a person standing in front of a window 91.4%
a person sitting in front of a window 87.1%
a man and a woman standing in front of a window 71.1%