Human Generated Data

Title

[Passengers on ship deck]
Date

unknown
People

Artist: Lyonel Feininger, American 1871 - 1956
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.149.27
Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Passengers on ship deck]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

unknown

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-04

Human 99.4
Person 99.4
Person 99
Clothing 92
Apparel 92
Handrail 69
Banister 69
Food 62
Meal 62
Wood 61.3
Dessert 59.1
Cake 59.1
Creme 59.1
Icing 59.1
Cream 59.1
Hat 58.6
Finger 56.7
Sleeve 56.4

Clarifai
created on 2021-04-04

people 99.7
two 98.7
adult 97.6
man 97.6
woman 97
wear 94.8
three 94.4
group together 94
group 93.1
veil 90.3
one 88.5
portrait 88
music 87.1
four 86.9
musician 85.2
actor 84.4
wedding 83.6
theater 82.7
facial expression 81.2
furniture 80

Imagga
created on 2021-04-04

parasol 43.2
hat 33.6
people 25.6
man 25.5
person 24.2
adult 23.3
clothing 21.5
vacation 19.6
umbrella 19.2
male 19.1
headdress 17.7
water 16.7
sitting 16.3
happy 15.7
summer 15.4
sombrero 15.2
outdoors 15
sky 14.7
couple 13.1
sea 12.5
outdoor 12.2
holiday 12.2
looking 12
travel 12
attractive 11.9
relaxation 11.7
lifestyle 11.6
outside 11.1
hair 11.1
love 11
happiness 11
canopy 10.9
smiling 10.8
leisure 10.8
smile 10.7
beach 10.6
fun 10.5
old 10.4
men 10.3
relax 10.1
child 10.1
ocean 10.1
activity 9.8
portrait 9.7
enjoy 9.4
tourist 9.3
boat 9.3
covering 9.3
alone 9.1
lady 8.9
handsome 8.9
senior 8.4
studio 8.4
tourism 8.2
shelter 8.1
bonnet 8.1
recreation 8.1
women 7.9
sand 7.9
day 7.8
standing 7.8
cloud 7.7
pretty 7.7
casual 7.6
fashion 7.5
worker 7.5
vehicle 7.5
human 7.5
city 7.5
one 7.5
sun 7.2
black 7.2
wet 7.2
romance 7.1
working 7.1
architecture 7

Google
created on 2021-04-04

Gesture 85.3
Black-and-white 84.7
Style 83.9
Hat 76.4
Monochrome 74.1
Monochrome photography 73.3
Vintage clothing 70.3
Rectangle 66.2
Street fashion 64.5
Flash photography 61.4
Photo caption 59
Road 54.8
Sitting 54.1
Fun 53.2
Photographic paper 53

Microsoft
created on 2021-04-04

text 90.5
wedding dress 89.3
person 89.2
outdoor 85.9
black and white 84.2
bride 80.3
clothing 80
water 62.7
woman 62.1

Face analysis

Amazon

Google

AWS Rekognition

Age 23-35
Gender Female, 51.8%
Calm 46.6%
Angry 28%
Sad 13.4%
Fear 8%
Surprised 1.9%
Happy 1.4%
Confused 0.5%
Disgusted 0.3%

AWS Rekognition

Age 27-43
Gender Female, 53.1%
Calm 70.6%
Sad 11.9%
Angry 6%
Happy 5.3%
Surprised 3.3%
Fear 2.2%
Confused 0.5%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a person sitting on a bench 81.6%
a person is sitting on a bench 75.6%
a person standing next to a bench 75.5%

Text analysis

Amazon

2G

Google

26
26