Human Generated Data

Title

[Lyonel Feininger and a nurse holding Laurence and Lux Feininger]

Date

1911?

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.413

Human Generated Data

Title

[Lyonel Feininger and a nurse holding Laurence and Lux Feininger]

People

Artist: Unidentified Artist,

Date

1911?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-07-01

Clothing 99.3
Apparel 99.3
Person 98.9
Human 98.9
Person 96.5
Person 92.3
Grass 92.2
Plant 92.2
Female 86.4
Footwear 86.3
Shoe 86.3
Dress 83.6
Outdoors 78.4
Face 78.4
Pants 77.7
Tree 73.6
People 71.1
Girl 69.3
Photo 66.4
Portrait 66.4
Photography 66.4
Woman 65.4
Hat 64.4
Coat 63.1
Finger 60.7
Leisure Activities 57.9
Play 56.1
Kid 55.8
Child 55.8
Costume 55.7
Overcoat 55.2

Imagga
created on 2022-07-01

sport 33.3
weapon 31.1
ball 27.1
outdoors 26.9
man 26.2
fun 24.7
play 24.1
people 24
playing 22.8
child 22.1
adult 22
outdoor 21.4
game equipment 21.3
player 21.2
active 21
happy 20.7
athlete 19.9
equipment 19.5
volleyball net 19.3
person 19.1
net 18.6
recreation 17.9
male 17.1
sword 16.7
happiness 16.5
outside 16.3
love 15.8
lifestyle 15.2
day 14.9
park 14.8
summer 14.8
game 14.3
joy 14.2
leisure 14.1
bow and arrow 13.8
competition 13.7
instrument 13.1
resort area 12.7
exercise 12.7
portrait 12.3
boy 12.2
swing 11.9
women 11.9
sports equipment 11.3
couple 11.3
activity 10.7
smile 10.7
family 10.7
cheerful 10.6
bride 10.5
grass 10.3
smiling 10.1
face 9.9
ballplayer 9.9
area 9.8
father 9.6
standing 9.6
sunny 9.5
spring 9.4
wedding 9.2
teenager 9.1
holding 9.1
dress 9
contestant 9
human 9
childhood 9
sky 8.9
kid 8.9
court 8.8
married 8.6
youth 8.5
club 8.5
beach 8.4
field 8.4
health 8.3
sports 8.3
blond 8.3
fitness 8.1
cricket equipment 8.1
little 7.9
tournament 7.8
athletic 7.7
golfer 7.7
daughter 7.6
two 7.6
world 7.6
marriage 7.6
region 7.6
fashion 7.5
senior 7.5
one 7.5
action 7.4
soccer ball 7.4
freedom 7.3
parent 7.3
cute 7.2
team 7.2
hair 7.1
racket 7.1
mask 7
together 7

Google
created on 2022-07-01

White 92.2
Human 89.7
Smile 89.4
Black-and-white 87.4
Tree 87.4
Standing 86.4
Gesture 85.3
Style 84.1
Grass 79.7
Monochrome 78.7
Monochrome photography 77.9
Plant 76.7
Fun 76.1
Vintage clothing 68.7
Event 68.3
Stock photography 65.6
Happy 65.4
Winter 59.2
Photo caption 59
Darkness 53.4

Microsoft
created on 2022-07-01

tree 99.7
outdoor 99
person 89.6
black and white 61.2
clothing 54.2

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 79.4%
Calm 30.4%
Surprised 24.8%
Happy 11.6%
Fear 9.8%
Sad 9.7%
Disgusted 8.9%
Confused 7.4%
Angry 3.8%

AWS Rekognition

Age 39-47
Gender Male, 79.7%
Calm 41.4%
Sad 18.8%
Angry 12.3%
Confused 9.9%
Surprised 9.8%
Happy 8.3%
Fear 6.9%
Disgusted 3.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 98.9%
Shoe 86.3%

Captions

Microsoft

a person holding a baseball bat 26.2%
a person holding a bat 26.1%