Human Generated Data

Title

[Lyonel and Lux Feininger]

Date

1932

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.151.29

Human Generated Data

Title

[Lyonel and Lux Feininger]

People

Artist: Unidentified Artist,

Date

1932

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-04-04

Face 99.1
Human 99.1
Person 98.3
Person 97.6
Clothing 91.7
Apparel 91.7
Beard 88
Finger 70.8
Accessories 69.4
Accessory 69.4
Tie 69.4
Food 60.8
Meal 60.8
Coat 56.8

Clarifai
created on 2021-04-04

people 99.9
adult 99
one 99
man 97.8
wear 95.9
two 95.4
music 94.5
administration 91.8
portrait 91.5
group 89.8
recreation 87.8
monochrome 87.2
facial expression 85.1
vehicle 85.1
musician 85
outfit 83.9
leader 82.8
veil 81.6
furniture 80.4
actor 80.3

Imagga
created on 2021-04-04

snow 22.4
man 22.2
winter 19.6
picket fence 17.5
people 16.2
adult 14.9
person 14.7
vehicle 14
fence 13.7
old 13.2
male 12.8
barrier 12.1
cold 12
passenger 12
human 11.2
outdoors 11.2
ice 10.3
happiness 10.2
historic 10.1
building 9.9
fun 9.7
bobsled 9.5
happy 9.4
lifestyle 9.4
architecture 9.4
head 9.2
car 9.2
sled 8.8
shop 8.7
hair 8.7
smiling 8.7
outside 8.5
travel 8.4
device 8.3
city 8.3
sky 8.3
one 8.2
vacation 8.2
worker 8.1
water 8
cool 8
holiday 7.9
smile 7.8
black 7.8
season 7.8
clothing 7.6
vintage 7.6
fashion 7.5
leisure 7.5
obstruction 7.5
barbershop 7.4
looking 7.2
transportation 7.2
love 7.1
glass 7.1
work 7.1

Google
created on 2021-04-04

Black 89.7
Black-and-white 86
Gesture 85.3
Style 84
Monochrome 78.4
Monochrome photography 77.9
Vintage clothing 73.3
Event 69.1
Cooking 64.5
Room 64.5
Stock photography 63.8
Art 62.3
Sitting 60.7
Font 60.2
History 58.3
Tableware 57.6
Eyewear 52.2
Uniform 50.3

Microsoft
created on 2021-04-04

person 99.6
man 97.7
black and white 91.4
text 90.3
human face 79.3
clothing 72.9

Face analysis

Amazon

Google

AWS Rekognition

Age 48-66
Gender Male, 54.4%
Calm 96.6%
Sad 2.7%
Confused 0.2%
Surprised 0.2%
Angry 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Tie 69.4%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 66%
a man standing in front of a mirror 65.9%
a man looking at the camera 65.8%