Human Generated Data

Title

[Lyonel and Andreas Feininger in play pen]

Date

1907

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.303

Human Generated Data

Title

[Lyonel and Andreas Feininger in play pen]

People

Artist: Unidentified Artist,

Date

1907

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.675.303

Machine Generated Data

Tags

Amazon
created on 2022-07-01

Clinic 98.4
Person 97.7
Human 97.7
Doctor 96.2
Operating Theatre 86.4
Hospital 86.4
Person 83
Indoors 75.1
Room 74.3
Surgeon 56.9
Face 55.3
Portrait 55.3
Photography 55.3
Photo 55.3
Person 53.5

Imagga
created on 2022-07-01

senior 43.1
man 34.9
people 34
portrait 33.6
person 33.6
elderly 31.6
adult 31.4
male 28.4
couple 27
old 26.5
happy 26.3
shower cap 24.2
cap 22.6
retired 22.3
retirement 21.1
mature 20.5
love 19.7
face 19.2
together 17.5
human 17.2
smile 17.1
wife 17.1
clothing 17
medical 16.8
hair 16.6
husband 16.5
negative 16.3
health 16
grandfather 15.4
groom 15.3
looking 15.2
lifestyle 15.2
happiness 14.9
headdress 14.8
surgeon 14.8
gray 13.5
film 12.8
expression 12.8
grandmother 12.7
pensioner 12.5
smiling 12.3
doctor 12.2
glasses 12
men 12
pretty 11.9
family 11.6
care 11.5
grandma 11.2
sitting 11.2
women 11.1
casual 11
two 11
work 11
aged 10.9
affection 10.6
medicine 10.6
look 10.5
nurse 10.4
alone 10
professional 10
photographic paper 9.9
hand 9.9
romantic 9.8
attractive 9.8
lady 9.7
covering 9.7
one 9.7
married 9.6
age 9.5
mask 9.4
head 9.2
joy 9.2
patient 9
cheerful 8.9
worker 8.9
indoors 8.8
older 8.7
eyes 8.6
illness 8.6
marriage 8.5
life 8.1
hospital 8.1
romance 8
handsome 8
home 8
bride 8
elder 7.9
scientist 7.8
lab 7.8
laboratory 7.7
research 7.6
togetherness 7.6
relationship 7.5
camera 7.4
wedding 7.4
dress 7.2
suit 7.2
to 7.1

Google
created on 2022-07-01

Microsoft
created on 2022-07-01

human face 94.7
person 90.6
text 90.1
black and white 83.1
clothing 82.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 95.6%
Happy 94.8%
Surprised 6.5%
Fear 5.9%
Sad 3.1%
Calm 1.3%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%

Captions

Microsoft
created on 2022-07-01

an old photo of a man 75.9%
a man sitting on a bed 38.2%
a man sitting in a chair 38.1%