Human Generated Data

Title

Untitled (Horace Pippin pointing to his painting with log cabin)
Date

1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5171
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (Horace Pippin pointing to his painting with log cabin)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.1
Human 99.1
Clothing 97.8
Apparel 97.8
Head 89.3
Home Decor 87.9
Painting 85.6
Art 85.6
Face 83.7
Coat 74.8
Furniture 74.5
Female 72.7
Plant 67.4
Suit 67
Overcoat 67
Screen 66.7
Electronics 66.7
Portrait 64.9
Photography 64.9
Photo 64.9
Potted Plant 64.7
Vase 64.7
Jar 64.7
Pottery 64.7
Monitor 61.5
Display 61.5
Person 61.1
Text 58.5
Woman 58.1
Lab Coat 57.4
Flooring 55.7

Imagga
created on 2022-01-23

laptop 38.8
computer 34.4
web site 31.8
man 31.6
envelope 30
business 29.2
male 28.4
person 25.9
home 25.5
monitor 24.9
office 24.9
technology 23.8
adult 23.7
container 22.1
people 20.6
sitting 20.6
working 20.3
work 19.6
smiling 19.5
happy 19.4
businessman 19.4
senior 17.8
indoors 17.6
professional 16.8
hand 16
notebook 15.7
communication 15.1
portrait 14.9
corporate 14.6
smile 13.5
looking 12.8
modern 12.6
elderly 12.5
wireless 12.4
job 12.4
finance 11.8
table 11.8
holding 11.6
using 11.5
one 11.2
mature 11.2
student 11
browsing 10.8
surfing 10.8
face 10.7
screen 10.6
retirement 10.6
bill 10.5
old 10.5
money 10.2
desk 10.1
shirt 10.1
horizontal 10
retired 9.7
education 9.5
women 9.5
career 9.5
men 9.4
human 9
bank 9
lady 8.9
paper 8.7
concentration 8.7
blank 8.6
tie 8.5
web 8.5
keyboard 8.4
attractive 8.4
room 8.2
lab coat 8.1
blackboard 8.1
currency 8.1
close 8
patient 8
coat 7.9
display 7.9
living room 7.8
specialist 7.8
serious 7.6
executive 7.6
savings 7.5
manager 7.4
closeup 7.4
camera 7.4
occupation 7.3
cash 7.3
design 7.3
alone 7.3
equipment 7.2
handsome 7.1
financial 7.1
worker 7.1

Google
created on 2022-01-23

White 92.2
Picture frame 89.8
Black 89.7
Smile 88.1
Font 80.8
Rectangle 76.3
Monochrome 73.9
Monochrome photography 72.8
Room 64.6
Stock photography 64
History 63.8
Art 61.4
Illustration 59
Suit 58.1
Cooking 57.6
Still life photography 57.2
Photo caption 55.5
Flash photography 54.3
Photographic paper 51.6
Symmetry 50.2

Microsoft
created on 2022-01-23

text 98.9
wall 97.5
indoor 97.5
man 95.8
person 86.8
clothing 81.1
black and white 77.7
drawing 76.2
posing 72.7
old 57.2
picture frame 13.2

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 71.6%
Happy 86.9%
Surprised 3.6%
Calm 3.6%
Confused 2.2%
Disgusted 1.7%
Sad 1.3%
Fear 0.4%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Painting 85.6%

Captions

Microsoft

a man standing in front of a mirror posing for the camera 59.8%
a man sitting in front of a mirror posing for the camera 47.6%
a man that is standing in front of a mirror posing for the camera 47.5%

Text analysis

Amazon

11588
LEST
11588.
NGIRL

Google

1588 15 88.
1588
15
88.