Human Generated Data

Title

Untitled (two men with piggy bank in front of posters)
Date

c. 1955
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20045

Human Generated Data

Title

Untitled (two men with piggy bank in front of posters)

People

Artist: Peter James Studio, American

Date

c. 1955

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20045

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.5
Apparel 99.5
Person 99.3
Human 99.3
Lab Coat 96
Coat 96
Furniture 91.1
Person 89
Person 87.8
Person 86.9
Person 85.1
Shoe 81.9
Footwear 81.9
Doctor 72.3
Lab 71.9
Table 68.5
Scientist 65.5
Tabletop 64.8
Chair 62.1
Clinic 58.4
Blackboard 56.5
Portrait 56.5
Photography 56.5
Face 56.5
Photo 56.5

Clarifai
created on 2023-10-22

people 99.8
adult 98.8
two 97.4
man 97.1
one 96.2
monochrome 96.2
group 93.1
wear 92.2
administration 91.8
furniture 89.6
music 88.1
facial expression 88
three 87.3
actor 87.2
indoors 87.1
leader 86
group together 83.9
portrait 83.7
vehicle 83
sit 82.9

Imagga
created on 2022-03-05

man 53.8
male 40.4
person 35
people 34.6
professional 29.4
office 28.2
adult 28.2
teacher 26.5
patient 25.4
businessman 24.7
indoors 24.6
business 24.3
smiling 23.9
lab coat 21.9
table 21.8
nurse 21.5
coat 20.9
specialist 20.9
senior 20.6
sitting 20.6
desk 19.1
room 19.1
meeting 18.9
happy 18.8
working 18.6
work 18.1
educator 17.6
clinic 17.4
education 17.3
team 17
portrait 16.8
hospital 16.2
talking 16.2
classroom 16.1
computer 15.2
home 15.2
medical 15
colleagues 14.6
blackboard 14.5
lifestyle 14.5
student 14.3
job 14.2
mature 14
couple 13.9
laptop 13.7
40s 13.6
doctor 13.2
case 13.1
group 12.9
occupation 12.8
looking 12.8
indoor 12.8
casual 12.7
elderly 12.4
together 12.3
teamwork 12.1
men 12
day 11.8
school 11.8
color 11.7
class 11.6
cheerful 11.4
corporate 11.2
health 11.1
businesswoman 10.9
worker 10.8
suit 10.8
sick person 10.5
businesspeople 10.4
happiness 10.2
smile 10
executive 9.9
technology 9.7
glasses 9.3
holding 9.1
to 8.9
discussing 8.8
educate 8.8
discussion 8.8
two people 8.8
women 8.7
clothing 8.6
illness 8.6
college 8.5
face 8.5
two 8.5
shirt 8.4
communication 8.4
camera 8.3
inside 8.3
care 8.2
medicine 7.9
business people 7.9
coworkers 7.9
teaching 7.8
retirement 7.7
exam 7.7
restaurant 7.7
adults 7.6
study 7.5
manager 7.5
coffee 7.4
20s 7.3
board 7.2
bright 7.2
interior 7.1
garment 7

Google
created on 2022-03-05

Table 96.1
Photograph 94.2
Black 89.6
Black-and-white 84.4
Style 83.9
Snapshot 74.3
Monochrome 74.2
Monochrome photography 73.7
T-shirt 73.5
Desk 73.4
Font 68
Room 67.4
Glass 67.2
Barware 66.3
Job 64.4
Recreation 63.4
Sitting 63.3
Suit 62.9
Games 61.6
Machine 60.7

Microsoft
created on 2022-03-05

text 99.6
person 91.3
man 86.4
indoor 85.3
clothing 83.8
black and white 78.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 87.9%
Calm 84.8%
Sad 14.6%
Happy 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 54-62
Gender Male, 99.9%
Happy 91.2%
Calm 5.8%
Surprised 1.4%
Disgusted 0.5%
Angry 0.4%
Confused 0.4%
Fear 0.2%
Sad 0.1%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Calm 77.4%
Happy 5.7%
Confused 5.5%
Disgusted 3.7%
Surprised 3%
Sad 2.2%
Angry 1.9%
Fear 0.6%

AWS Rekognition

Age 38-46
Gender Male, 100%
Calm 39.1%
Happy 16.5%
Confused 16.5%
Sad 10.1%
Angry 9.4%
Disgusted 5.2%
Surprised 2.7%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Shoe
Person 99.3%
Person 89%
Person 87.8%
Person 86.9%
Person 85.1%
Shoe 81.9%

Categories

Imagga

interior objects 99.4%

Captions

Microsoft
created on 2022-03-05

a man sitting on a counter 68.3%
a man sitting on a table 53%
a man sitting at a table 52.9%

Text analysis

Amazon

SIZES!
Buy
ECONOMY
WITH ECONOMY
BUY
WITH
BUY and
and
These
Economy
Magazines
your
with Economy Sizes!
Sizes!
with
$ave
Dru
PANION
uy and $ave
uy
Collier's
Buy and $ave
erican
These famoys Magazines and your Dru
merican
an
llier's
-
COMPANIO
famoys
a Economy Sizes!
SAVE
COMPANION
meri an
you
- Oruggin my
and you way
the
my
meri
the money -
way
a
de
you with
BAD
These forest
Oruggin
de Food fresh
ein
money
Figer
Food
Book
KA Figer Book
Por the money ein the
REPUBLIC
Program
KA
fresh
Por the
forest
a EXPERIA
for
excolligg.com
EXPERIA

Google

gaines uy Save and Alier's Economy Sizes! BUY SAVE merican (COMPANION WITH ECONOMY SIZES! The fun Mynes Buy - Save and Collier's with Economy Sizes! erican PANION
gaines
uy
Save
and
Alier's
Economy
Sizes!
BUY
SAVE
merican
(COMPANION
WITH
ECONOMY
SIZES!
The
fun
Mynes
Buy
-
Collier's
with
erican
PANION