Human Generated Data

Title

[Street scene, Germany]

Date

1940s-1950s

People

Artist: Lyonel Feininger, American 1871 - 1956

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.1003.3

Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Street scene, Germany]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1940s-1950s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Clothing 100
Apparel 100
Hat 99.8
Person 99.8
Human 99.8
Person 98.5
Person 98.5
Person 97.1
Transportation 96.9
Automobile 96.9
Vehicle 96.9
Car 96.9
Wheel 95.1
Machine 95.1
Person 93.1
Person 90
Wheel 89.1
Sun Hat 86.4
Person 86.1
Person 76.1
Person 74.7
Face 67.8
City 62.1
Town 62.1
Building 62.1
Metropolis 62.1
Urban 62.1
Cowboy Hat 57.5
Road 56.2

Clarifai
created on 2019-11-16

people 99.8
adult 98.5
man 97.5
street 97.3
woman 96.9
monochrome 95.9
group together 95.7
group 94.4
one 93.5
wear 91.6
two 91.4
vehicle 91.2
many 89.1
transportation system 88.9
music 84.1
several 84
indoors 83.4
airport 82.9
city 81.8
recreation 81

Imagga
created on 2019-11-16

hat 100
headdress 100
cowboy hat 100
clothing 71
sombrero 61.5
covering 38.4
consumer goods 36.8
cup 17.2
cowboy 16.7
restaurant 15.7
food 13.9
people 13.9
male 13.5
man 13.4
old 13.2
happy 13.1
tea 13.1
person 13
black 12.6
drink 12.5
table 12.1
western 11.6
smile 11.4
portrait 11
boy 10.4
shirt 10.3
dinner 10.2
indoor 10
traditional 10
style 9.6
spoon 9.5
coffee 9.3
hand 9.1
kitchen 8.9
saucer 8.7
close 8.6
casual 8.5
relaxation 8.4
child 8.3
meal 8.3
breakfast 8
water 8
interior 8
travel 7.7
setting 7.7
culture 7.7
two 7.6
hot 7.5
enjoy 7.5
sugar 7.5
guy 7.3
light 7.3
room 7.3
dish 7.2
smiling 7.2
lifestyle 7.2
women 7.1
face 7.1
kid 7.1

Google
created on 2019-11-16

Microsoft
created on 2019-11-16

hat 99.9
fashion accessory 99.6
fedora 98.8
sun hat 97.8
person 97.6
cowboy hat 95.9
black and white 94.6
text 93.9
street 91.4
clothing 86.1
monochrome 84.8

Face analysis

Amazon

Google

AWS Rekognition

Age 50-68
Gender Female, 54.7%
Disgusted 46.3%
Calm 46.4%
Angry 47%
Confused 45.7%
Fear 45.2%
Sad 48.9%
Surprised 45.3%
Happy 45.3%

AWS Rekognition

Age 50-68
Gender Female, 50.2%
Disgusted 45.1%
Happy 45.2%
Angry 45.8%
Confused 45.2%
Calm 50.4%
Fear 45.2%
Sad 47.9%
Surprised 45.2%

AWS Rekognition

Age 21-33
Gender Male, 97.3%
Fear 57.2%
Angry 28.4%
Sad 1.1%
Happy 0.2%
Calm 9%
Confused 1.1%
Surprised 2.6%
Disgusted 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.8%
Person 99.8%
Car 96.9%
Wheel 95.1%

Captions

Microsoft

a man standing in front of a bus 62.6%
a man standing in front of a store window 62.5%
a man standing in front of a bus window 62.4%

Text analysis

Amazon

SCHBODER
Harr
Harr HFCAFA SCHBODER
HFCAFA
3P0eL
3P0eL S
S

Google

HAOLFA
HAOLFA JSCHRODER SDER
JSCHRODER
SDER