Human Generated Data

Title

[Wysse, Tomas, and Lyonel Feininger at 235 East 22nd Street, New York]
Date

1950
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.355.11

Human Generated Data

Title

[Wysse, Tomas, and Lyonel Feininger at 235 East 22nd Street, New York]

People

Artist: Unidentified Artist,

Date

1950

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Gift of T. Lux Feininger, BRLF.355.11

Machine Generated Data

Tags

Amazon
created on 2019-05-29

Person 99.9
Human 99.9
Person 99.5
Sitting 98.4
Person 96.9
Clothing 96.4
Apparel 96.4
Tie 87.1
Accessory 87.1
Accessories 87.1
Furniture 82.7
Indoors 80
Room 78.9
Shorts 72.8
Shirt 69.8
Tie 69.1
Sleeve 67.3
Long Sleeve 67.3
People 63.1
Crowd 62.2
Pants 60.2
Screen 56.9
Monitor 56.9
Electronics 56.9
Display 56.9
Home Decor 55.4

Clarifai
created on 2019-05-29

people 99.9
adult 98.9
group together 98.3
group 98
man 97.4
sit 97
administration 96.9
leader 96.4
several 94
furniture 93.2
two 92.6
four 90.9
woman 90.8
many 88.8
three 86.1
elderly 85.7
chair 85.3
wear 82.3
portrait 81.5
facial expression 80.9

Imagga
created on 2019-05-29

man 46.4
male 37.8
people 37.4
couple 33.1
home 31.9
senior 31.9
person 29.1
grandfather 28.2
indoors 26.4
happy 26.3
together 25.4
smiling 25.3
men 23.2
adult 22.5
sitting 22.3
mature 19.5
kin 19.3
elderly 19.2
smile 18.5
talking 18.1
family 17.8
worker 17.6
work 17.3
working 16.8
office 16.7
business 16.4
waiter 16.2
barroom 15.8
cheerful 15.5
professional 15.3
meeting 15.1
businessman 15
grandma 14.8
60s 14.7
two people 14.6
husband 14.3
women 14.2
enjoying 14.2
executive 13.8
70s 13.8
lifestyle 13.7
restaurant 13.7
patient 13.4
wife 13.3
old 12.6
portrait 12.3
table 12.1
wine 12
meal 11.8
retirement 11.5
dining-room attendant 11.4
room 11.4
hairdresser 11.4
doctor 11.3
computer 11.2
employee 11.2
communication 10.9
drink 10.9
senior adult 10.9
grandmother 10.8
older 10.7
face 10.7
food 10.4
friends 10.3
love 10.3
happiness 10.2
two 10.2
father 10.1
mother 10
businesswoman 10
care 9.9
team 9.9
sixties 9.8
hospital 9.8
middle aged 9.7
medical 9.7
group 9.7
eating 9.3
alcohol 9.3
holding 9.1
aged 9.1
dinner 9
job 8.9
casual clothing 8.8
40s 8.8
colleagues 8.7
retired 8.7
dad 8.6
corporate 8.6
adults 8.5
togetherness 8.5
casual 8.5
teamwork 8.4
leisure 8.3
handsome 8
interior 8
color 7.8
having 7.8
couch 7.7
modern 7.7
30s 7.7
looking camera 7.7
drinking 7.7
businesspeople 7.6
friendship 7.5
fun 7.5
child 7.4
inside 7.4
20s 7.3
indoor 7.3
laptop 7.3
lunch 7.1
pensioner 7.1
to 7.1
day 7.1
attractive 7

Google
created on 2019-05-29

Photograph 97.3
People 95.2
Snapshot 89.5
Standing 79.6
Black-and-white 74.4
Monochrome 70.2
Family 68.8
Photography 67.8
Room 65.7
Vintage clothing 61.7
Stock photography 59.4
Sitting 54.1

Microsoft
created on 2019-05-29

person 98.7
clothing 96.7
man 87.2
furniture 85.3
old 79.9
table 76.3
black 76.3
posing 72.9
smile 57.3

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 10-15
Gender Male, 90%
Angry 12.5%
Calm 78.2%
Surprised 0.5%
Happy 0.7%
Sad 6.8%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 29-45
Gender Female, 97.8%
Disgusted 1.9%
Happy 4.8%
Confused 1.3%
Surprised 1.3%
Calm 83.8%
Angry 1.8%
Sad 5.1%

AWS Rekognition

Age 45-66
Gender Male, 77.3%
Sad 5.7%
Surprised 2.5%
Disgusted 6.4%
Confused 1%
Angry 3.5%
Happy 8.8%
Calm 72%

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 59
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.9%
Tie 87.1%

Categories

Imagga

people portraits 98.7%