Human Generated Data

Title

[Julia and Wysse Feininger]
Date

1944?
People

Artist: Lyonel Feininger, American 1871 - 1956
Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.356.13
Copyright

© Artists Rights Society (ARS), New York / VG Bild-Kunst, Bonn

Human Generated Data

Title

[Julia and Wysse Feininger]

People

Artist: Lyonel Feininger, American 1871 - 1956

Date

1944?

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-05-29

Person 99.6
Human 99.6
Person 99
Person 97.3
Sitting 74
Finger 63.6
Shelf 59.8
Screen 56.9
Electronics 56.9
Display 56.9
Monitor 56.9

Clarifai
created on 2019-05-29

people 99.8
adult 99.1
man 96.6
two 95.8
group 95.7
woman 94.7
administration 93.9
furniture 92.7
indoors 92.1
group together 90.4
three 89.9
room 88.4
wear 86.3
sit 85.2
facial expression 84.2
leader 83.7
several 80.5
desk 80.4
portrait 79.9
four 79.8

Imagga
created on 2019-05-29

grandma 76
senior 49.7
home 47.1
indoors 43.1
people 43
man 42.4
male 41.2
couple 36.6
person 35.8
elderly 34.5
mature 34.4
grandfather 31
happy 28.2
retired 28.2
adult 27.8
smiling 26.8
together 26.3
lifestyle 26
old 25.8
husband 25.8
sitting 24.9
computer 24.4
retirement 24
laptop 23.4
wife 22.8
looking 20.8
family 20.5
room 19.5
older 17.5
office 17.1
happiness 16.5
horizontal 15.9
two people 15.6
pensioner 15.3
casual 15.3
two 15.3
smile 15
cheerful 14.6
age 14.3
men 13.8
grandmother 13.7
60s 13.7
aged 13.6
togetherness 13.2
holding 13.2
hospital 13.2
professional 13.1
portrait 13
70s 12.8
face 12.8
technology 12.6
health 12.5
working 12.4
medical 12.4
care 12.4
glasses 12
nurse 12
patient 12
inside 12
women 11.9
business 11.6
table 11.3
clothing 11.2
color 11.1
love 11.1
mother 10.9
teacher 10.9
active 10.8
married 10.6
aging 10.6
desk 10.4
relaxed 10.3
camera 10.2
indoor 10.1
child 9.9
gray 9.9
gray hair 9.9
worker 9.8
good mood 9.8
to 9.7
interior 9.7
illness 9.5
talking 9.5
day 9.4
doctor 9.4
modern 9.1
relaxing 9.1
fun 9
browsing 8.8
their 8.8
middle aged 8.8
couch 8.7
blond 8.5
meeting 8.5
relationship 8.4
help 8.4
playing 8.2
parent 8.2
handsome 8
businessman 8
hair 7.9
clinic 7.9
pension 7.9
seniors 7.9
sixties 7.9
living room 7.8
seated 7.8
discussion 7.8
paying 7.8
partner 7.7
using 7.7
sofa 7.7
living 7.6
learning 7.5
leisure 7.5
one 7.5
occupation 7.3
alone 7.3
lady 7.3
kitchen 7.2
kid 7.1

Google
created on 2019-05-29

Photograph 97.1
Snapshot 88.7
Black-and-white 88.5
Monochrome photography 76.2
Photography 74.8
Monochrome 74.2
Style 51

Microsoft
created on 2019-05-29

person 98.5
man 93
human face 90.9
clothing 88.9
window 83.9
black and white 79.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Female, 96.3%
Surprised 0.2%
Disgusted 0.1%
Confused 0.2%
Happy 95%
Angry 0.1%
Calm 1.2%
Sad 3.1%

AWS Rekognition

Age 27-44
Gender Female, 91.2%
Surprised 1.7%
Disgusted 13.2%
Angry 2.3%
Confused 1.4%
Sad 3.8%
Happy 2.9%
Calm 74.8%

Microsoft Cognitive Services

Age 52
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a man sitting in front of a window 84.8%
a group of people sitting in front of a window 82.3%
a man sitting next to a window 81.6%