Human Generated Data

Title

[Mrs. Christophe, her son Christian, and Lyonel and Julia Feininger dining outdoors, Heringsdorf?]
Date

1909?
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.80

Human Generated Data

Title

[Mrs. Christophe, her son Christian, and Lyonel and Julia Feininger dining outdoors, Heringsdorf?]

People

Artist: Unidentified Artist,

Date

1909?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-07-01

Clothing 100
Apparel 100
Hat 99.2
Sun Hat 98
Person 97.4
Human 97.4
Person 93.7
Person 90
Hat 83.7
Cowboy Hat 74.2

Imagga
created on 2022-07-01

waiter 70
dining-room attendant 54.6
worker 43.2
employee 41.5
man 39
person 36.4
male 33.3
people 29
seller 27.6
adult 22.2
work 22.1
hat 19.6
working 18.6
medical 18.5
professional 18.2
doctor 17.9
clothing 16.6
hospital 16
job 15.9
men 14.6
senior 14.1
business 14
occupation 13.7
health 13.2
indoors 13.2
patient 13
nurse 12.6
smiling 12.3
portrait 12.3
happy 11.9
food 11.7
kitchen 11.6
lifestyle 11.6
medicine 11.4
uniform 11.4
face 11.4
office 11.2
sitting 11.2
home 11.2
hand 10.6
30s 10.6
profession 10.5
couple 10.5
industry 10.2
20s 10.1
smile 10
restaurant 9.9
team 9.9
scientist 9.8
lab 9.7
businessman 9.7
chef 9.7
looking 9.6
exam 9.6
table 9.5
two 9.3
cook 9.1
handsome 8.9
interior 8.8
surgery 8.8
cooking 8.7
women 8.7
standing 8.7
laboratory 8.7
day 8.6
businesspeople 8.5
adults 8.5
casual 8.5
clothes 8.4
shirt 8.4
building 8.3
holding 8.3
one 8.2
computer 8
science 8
happiness 7.8
mid adult 7.7
busy 7.7
marimba 7.7
looking camera 7.7
old 7.7
illness 7.6
research 7.6
dinner 7.6
horizontal 7.5
care 7.4
bartender 7.4
surgeon 7.4
indoor 7.3
room 7.3
businesswoman 7.3
color 7.2
clinic 7.1
together 7

Google
created on 2022-07-01

Hat 94.6
White 92.2
Sun hat 90.8
Fedora 89
Fashion 88.5
Black-and-white 84.2
Style 83.9
Vintage clothing 74.5
Event 73.6
Monochrome 73
Monochrome photography 72.3
Fun 71.8
Cowboy hat 69.9
Fashion accessory 67.4
Sitting 64.5
Art 63.6
Costume hat 62.5
Suit 59.7
Cap 59.2
Music 53.7

Microsoft
created on 2022-07-01

hat 99.6
person 99.3
fashion accessory 98.4
fedora 95.4
clothing 94.1
cowboy hat 91.6
human face 90
indoor 89.9
black and white 88.4
sun hat 85.5
man 75.9
statue 75.5
text 69.7

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 53.4%
Disgusted 30.4%
Happy 28.1%
Calm 15.4%
Surprised 8.4%
Sad 8.1%
Fear 7.9%
Confused 6.4%
Angry 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Hat 99.2%
Person 97.4%

Captions

Microsoft

a man sitting at a table 79.2%
a man sitting on a table 69.5%
a group of people sitting at a table 69.4%

Text analysis

Google

MINE