Human Generated Data

Title

[Lyonel Feininger with Galka Scheyer at her house in Hollywood, California]

Date

1936

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.142.30

Human Generated Data

Title

[Lyonel Feininger with Galka Scheyer at her house in Hollywood, California]

People

Artist: Unidentified Artist,

Date

1936

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.142.30

Machine Generated Data

Tags

Amazon
created on 2021-04-04

Person 99.7
Human 99.7
Person 98.2
Clothing 88.6
Apparel 88.6
Finger 73.5
Undershirt 69.6
Leisure Activities 66.1
Dance 64.9
Dance Pose 62.4
Person 50.6

Clarifai
created on 2021-04-04

people 99.9
adult 99.1
monochrome 98.4
man 97.9
two 97.7
one 96.8
portrait 95.6
woman 92.1
wear 91.5
facial expression 90.4
administration 90.1
group 89.7
indoors 89.3
window 89.2
street 88.1
music 87.3
three 85.2
interaction 82.5
room 82.4
musician 81.8

Imagga
created on 2021-04-04

barbershop 95.3
shop 75.5
mercantile establishment 57.6
hairdresser 42.9
place of business 38.4
man 26.9
people 23.4
male 21.3
establishment 19.2
person 18.4
home 18.3
black 16.8
portrait 16.8
hair 16.6
adult 16.2
lifestyle 15.9
happy 15.7
old 15.3
senior 15
smile 15
love 14.2
pretty 14
smiling 13.7
face 13.5
couple 13.1
family 11.6
human 11.2
head 10.9
lady 10.5
attractive 10.5
casual 10.2
child 10.1
girls 10
cheerful 9.7
looking 9.6
body 9.6
husband 9.5
wife 9.5
grandma 9.3
skin 9.3
mature 9.3
grandfather 9.3
hand 9.1
dress 9
sexy 8.8
elderly 8.6
sitting 8.6
men 8.6
joy 8.3
room 8.2
indoors 7.9
cute 7.9
happiness 7.8
retired 7.8
sad 7.7
retirement 7.7
married 7.7
youth 7.7
two 7.6
healthy 7.6
fashion 7.5
relaxation 7.5
clean 7.5
one 7.5
gray 7.2
mother 7.2
blond 7.2
wet 7.2
kid 7.1
little 7.1

Google
created on 2021-04-04

Black-and-white 85.8
Gesture 85.3
Style 84
T-shirt 77.6
Monochrome photography 74.6
Monochrome 72.9
Event 71.6
Room 67.2
Glass 66.8
Conversation 63
Stock photography 62.9
Sitting 62.7
Happy 59.4
Street 59.1
Eyewear 58.5
Font 52.8
Portrait 50.8

Microsoft
created on 2021-04-04

person 99
wedding dress 98.2
bride 95.5
text 95.2
black and white 87.2
clothing 86.6
woman 77.1
human face 76.9
dress 59.3
wedding 56.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 18-30
Gender Male, 74.1%
Calm 58.8%
Sad 39%
Happy 1%
Confused 0.7%
Angry 0.3%
Fear 0.1%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 39-57
Gender Male, 79.4%
Surprised 24.8%
Calm 22.6%
Fear 16%
Sad 14.8%
Confused 8.1%
Angry 7.4%
Happy 3.5%
Disgusted 2.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Categories

Captions

Microsoft
created on 2021-04-04

a man and a woman standing in front of a window 43.8%