Human Generated Data

Title

[Lyonel Feininger and sons on the beach, Deep, Baltic Coast]
Date

1932
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.164.23

Human Generated Data

Title

[Lyonel Feininger and sons on the beach, Deep, Baltic Coast]

People

Artist: Unidentified Artist,

Date

1932

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-04

Human 99.8
Person 99.8
Person 99.7
Person 98.7
Clothing 86.9
Shoe 86.9
Footwear 86.9
Apparel 86.9
Tarmac 86
Asphalt 86
Shoe 83.2
Leisure Activities 78.7
Sport 75.5
Sports 75.5
Dance Pose 67.7
Pedestrian 58.9
Road 58.6
People 55.7
Shoe 50.5

Clarifai
created on 2021-04-04

people 99.8
adult 97.3
man 97.2
street 95.6
group together 95.4
monochrome 95.4
woman 94.5
two 93.2
group 90.3
music 90.2
child 87.4
guitar 87.1
musician 85
wear 82.2
three 81.1
actor 80
dancing 79.3
recreation 78.9
dancer 77.3
competition 74.6

Imagga
created on 2021-04-04

brass 94.9
wind instrument 72.8
musical instrument 49.1
trombone 46.8
cornet 40.2
man 32.2
people 22.9
male 22.7
person 21.7
bugle 20.5
device 18.3
sport 17.8
fun 17.2
adult 16.3
horn 15.1
leisure 14.9
competition 14.6
recreation 14.3
outdoor 13.8
outdoors 13.4
game 12.5
summer 12.2
boy 12.2
ball 11.6
sky 11.5
playing 10.9
danger 10.9
player 10.8
walking 10.4
active 10.4
play 10.3
men 10.3
dark 10
exercise 10
mask 9.9
old 9.7
portrait 9.7
military 9.7
standing 9.6
grass 9.5
happy 9.4
weapon 9.4
lifestyle 9.4
uniform 9.3
beach 9.3
street 9.2
field 9.2
city 9.1
park 9.1
clothing 9
sun 8.8
war 8.7
hair 8.7
happiness 8.6
youth 8.5
club 8.5
human 8.2
protection 8.2
dirty 8.1
sunset 8.1
instrumentality 7.9
athlete 7.9
gun 7.9
child 7.9
sand 7.9
couple 7.8
tournament 7.8
swing 7.8
outside 7.7
attractive 7.7
two 7.6
hand 7.6
silhouette 7.4
vacation 7.4
industrial 7.3
activity 7.2
history 7.2
love 7.1
day 7.1

Google
created on 2021-04-04

Gesture 85.3
Black-and-white 83.5
Tints and shades 76.4
Flash photography 74.4
Snapshot 74.3
Suit 73.8
Vintage clothing 73.5
Monochrome photography 71.8
Monochrome 70.3
Recreation 70
Stock photography 63.9
Photo caption 63.5
Event 62.7
Holding hands 62
Room 55.2
Fun 53.8

Microsoft
created on 2021-04-04

outdoor 97.6
black and white 94.7
person 93.8
clothing 89.6
man 88
text 83.1
monochrome 81

Face analysis

Amazon

Google

AWS Rekognition

Age 26-40
Gender Female, 73.7%
Calm 96%
Sad 2.4%
Happy 0.5%
Angry 0.5%
Confused 0.2%
Fear 0.2%
Disgusted 0.2%
Surprised 0.1%

AWS Rekognition

Age 22-34
Gender Female, 64.9%
Sad 74.4%
Calm 12.2%
Fear 9.6%
Angry 1.2%
Surprised 1%
Happy 0.8%
Confused 0.5%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 86.9%

Captions

Microsoft

a group of people standing in front of a building 83.9%
a group of people standing next to a building 83.8%
a group of people standing outside of a building 83.7%