Human Generated Data

Title

[Mr. and Mrs. Francis Christophe, their son Christian, and Julia Feininger dining outdoors, Heringsdorf?, Baltic Coast]
Date

1909?
People

Artist: Lyonel Feininger, American 1871 - 1956
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.69
Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Mr. and Mrs. Francis Christophe, their son Christian, and Julia Feininger dining outdoors, Heringsdorf?, Baltic Coast]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1909?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-07-01

Clothing 100
Apparel 100
Hat 99.9
Sun Hat 99.6
Hat 99.6
Person 98.2
Human 98.2
Person 98
Person 90.2
Cowboy Hat 74.6

Imagga
created on 2022-07-01

lab coat 46.1
person 40.4
coat 39.4
man 35.6
male 29.8
worker 29.5
waiter 28.7
medical 27.4
people 24
professional 22.6
dining-room attendant 22.2
work 22
laboratory 21.2
doctor 20.7
men 20.6
scientist 20.6
employee 19.9
lab 19.4
science 18.7
adult 18.2
garment 18.2
research 18.1
medicine 17.6
clothing 17.1
hospital 17.1
nurse 16.1
health 15.3
biology 15.2
seller 15
face 14.9
chemistry 14.5
smiling 14.5
white 14.1
senior 14.1
happy 13.8
experiment 13.6
looking 13.6
portrait 13.6
surgeon 13.6
working 13.2
hat 12.8
scientific 12.6
uniform 12.5
profession 12.4
patient 11.9
couple 11.3
occupation 11
happiness 11
microscope 10.9
lifestyle 10.8
kitchen 10.7
handsome 10.7
chemical 10.7
job 10.6
cheerful 10.6
exam 10.5
serious 10.5
business 10.3
suit 9.9
businessman 9.7
chef 9.7
table 9.5
study 9.3
glasses 9.3
cook 9.1
hand 9.1
confident 9.1
student 9.1
mask 8.9
researcher 8.9
technician 8.8
surgery 8.8
busy 8.7
test 8.7
sitting 8.6
attractive 8.4
successful 8.2
care 8.2
equipment 8.1
school 8.1
groom 8
women 7.9
love 7.9
sterile 7.9
smile 7.8
clinic 7.8
standing 7.8
scholar 7.7
looking camera 7.7
development 7.6
college 7.6
outdoors 7.5
holding 7.4
room 7.3
laptop 7.3
success 7.2
color 7.2
computer 7.2
team 7.2
day 7.1

Google
created on 2022-07-01

Photograph 94.2
Hat 92
Black 89.7
Black-and-white 84.5
Style 83.8
Cooking 79.6
Monochrome photography 77.4
Sun hat 76.1
Monochrome 75.6
Chef 75.3
Snapshot 74.3
Event 73.2
Service 69.8
Job 68.6
Chef's uniform 67.3
Apron 67.2
Entertainment 67
Cook 66.6
Stock photography 65.4
Performing arts 65.1

Microsoft
created on 2022-07-01

hat 99.9
fashion accessory 99.6
person 98.4
text 97.6
fedora 97.2
clothing 95.9
sun hat 95.4
cowboy hat 95.3
black and white 95.1
man 64
human face 63.1
monochrome 58.3
sombrero 57.1
dish 47

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 93.6%
Disgusted 36.6%
Calm 31.3%
Sad 20.6%
Surprised 7.7%
Fear 6.9%
Happy 5.3%
Confused 2.9%
Angry 1.4%

AWS Rekognition

Age 16-24
Gender Male, 99.3%
Calm 56.6%
Surprised 28.8%
Disgusted 16.2%
Fear 6.3%
Sad 2.6%
Angry 1.3%
Happy 1.3%
Confused 1.1%

AWS Rekognition

Age 31-41
Gender Male, 91.4%
Sad 98.3%
Calm 14.3%
Confused 13.2%
Fear 7.3%
Surprised 6.8%
Happy 6.6%
Angry 3.6%
Disgusted 2.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Hat 99.9%
Person 98.2%

Captions

Microsoft

a person wearing a hat 73.1%
a group of people standing around a table 66.9%
a person standing on a table 66%

Text analysis

Google

ZHZAS