Human Generated Data

Title

Russian Orthodox Fund, New York City
Date

October 1975
People

Artist: Larry Fink, American born 1941
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of George and Alexandra Stephanopoulos, 2014.478
Copyright

© Larry Fink

Human Generated Data

Title

Russian Orthodox Fund, New York City

People

Artist: Larry Fink, American born 1941

Date

October 1975

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Person 97.5
Human 97.5
Person 97
Sitting 94
Leisure Activities 92.6
Sphere 92.6
Indoors 89.5
Room 89.3
Overcoat 88.2
Apparel 88.2
Coat 88.2
Suit 88.2
Clothing 88.2
Musician 87
Musical Instrument 87
Interior Design 86.4
Piano 86
Performer 83.7
Wood 83.1
Living Room 82.2
Pianist 80.7
Hardwood 76.8
Flooring 67
Face 63.1
Couch 61.3
Furniture 61.3
Photo 55.6
Photography 55.6
Portrait 55.6
Floor 55.4
Head 55.1

Clarifai
created on 2018-02-09

people 99.7
adult 98.2
leader 98.2
chair 96.7
one 95.5
room 95.5
man 94.9
administration 94.7
furniture 94.4
portrait 94.1
two 92.3
group 90.6
group together 88.1
home 88
three 86.1
desk 81.2
indoors 80.7
woman 79.4
concentration 74.2
monochrome 72.9

Imagga
created on 2018-02-09

office 47.6
man 44.3
business 41.9
businessman 41.5
computer 36.6
male 35.5
person 33
laptop 32.7
desk 31.6
sitting 30.9
people 30.7
smiling 30.4
adult 29.1
meeting 28.3
work 26.7
executive 26.5
happy 26.3
professional 24.5
suit 24.3
group 24.2
working 23.8
indoors 23.7
corporate 23.2
table 23
looking 21.6
television 20.9
businesswoman 20.9
smile 19.9
manager 19.5
cheerful 19.5
team 18.8
job 18.6
workplace 18.1
men 18
colleagues 17.5
technology 17.1
communication 16.8
confident 16.4
teacher 16.3
handsome 16
home 15.9
together 15.8
teamwork 15.8
happiness 15.7
women 15
portrait 14.9
indoor 14.6
lifestyle 14.4
talking 14.3
businesspeople 14.2
worker 13.3
room 13
coworkers 12.8
tie 12.3
career 12.3
color 12.2
education 12.1
mature 12.1
success 12.1
discussion 11.7
corporation 11.6
30s 11.5
director 11.3
couple 11.3
senior 11.2
modern 11.2
casual 11
conference 10.7
businessmen 10.7
partners 10.7
notebook 10.3
keyboard 10.3
horizontal 10
one 9.7
standing 9.6
adults 9.5
student 9.4
relaxed 9.4
two 9.3
coffee 9.3
positive 9.2
house 9.2
occupation 9.2
successful 9.1
boardroom 8.9
educator 8.9
associates 8.8
discussing 8.8
consultant 8.8
look 8.8
two people 8.7
mid adult 8.7
planning 8.7
reading 8.6
attractive 8.4
friendly 8.2
conversation 7.8
couch 7.7
college 7.6
females 7.6
sit 7.6
enjoyment 7.5
presentation 7.4
holding 7.4
speaker 7.4
20s 7.3
alone 7.3
secretary 7.3
cup 7.2
monitor 7.2
family 7.1
face 7.1
broadcasting 7.1

Google
created on 2018-02-09

photograph 94.9
black and white 85.4
furniture 73.3
table 72.1
design 64.9
gentleman 64.4
monochrome photography 61.1
monochrome 60.3
interior design 55.5

Microsoft
created on 2018-02-09

wall 97.7
indoor 97.4
person 85.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-53
Gender Male, 99.3%
Angry 1.9%
Calm 11%
Sad 1.5%
Confused 23.4%
Disgusted 2.6%
Happy 56.9%
Surprised 2.6%

AWS Rekognition

Age 35-52
Gender Male, 99.7%
Happy 0.9%
Angry 3%
Surprised 1.7%
Sad 10.1%
Disgusted 0.8%
Calm 80.2%
Confused 3.3%

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 77
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.5%
Suit 88.2%

Captions

Microsoft

a person sitting at a desk 89.8%
a man and a woman sitting at a desk 79.6%
a person sitting on a desk 79.5%