Human Generated Data

Title

Untitled (woman buying sausage from butcher)

Date

1945

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14594

Human Generated Data

Title

Untitled (woman buying sausage from butcher)

People

Artist: Jack Gould, American

Date

1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.3
Person 99.3
Person 96.9
Finger 59.3
Shelf 59.1
Window 56.7
Shop 56.6
Cafeteria 56.5
Restaurant 56.5

Imagga
created on 2022-01-29

barbershop 51.5
shop 48.5
mercantile establishment 35.6
man 30.9
people 29.5
male 27.6
room 27.6
classroom 27.3
person 25.2
place of business 23.8
business 21.9
blackboard 20.4
office 19.9
counter 19.8
old 18.1
senior 16.9
portrait 15.5
computer 15.3
businessman 15
school 14.9
indoors 14.9
happy 14.4
adult 14.1
looking 12.8
indoor 12.8
building 12.7
work 12.5
teacher 12.3
smiling 12.3
education 12.1
casual 11.9
establishment 11.8
finance 11.8
working 11.5
one 11.2
laptop 11.2
men 11.2
sitting 11.2
class 10.6
group 10.5
student 10
aged 9.9
face 9.9
holding 9.9
modern 9.8
success 9.7
desk 9.6
retirement 9.6
elderly 9.6
lifestyle 9.4
mature 9.3
smile 9.3
back 9.2
hand 9.1
chair 9.1
black 9
job 8.8
interior 8.8
newspaper 8.7
studying 8.6
day 8.6
corporate 8.6
money 8.5
monitor 8.5
horizontal 8.4
city 8.3
board 8.1
financial 8
home 8
together 7.9
architecture 7.8
retired 7.7
professional 7.7
notes 7.7
exchange 7.6
college 7.6
career 7.6
house 7.5
alone 7.3
hair 7.1
women 7.1

Google
created on 2022-01-29

Microsoft
created on 2022-01-29

text 98.9
person 96.9
indoor 89.8
black and white 82.2
clothing 61.9
computer 58.3
furniture 51.5

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Sad 41.5%
Happy 29.1%
Calm 8.8%
Confused 7.1%
Angry 6.1%
Disgusted 3.4%
Surprised 2.7%
Fear 1.4%

AWS Rekognition

Age 19-27
Gender Female, 98.2%
Calm 82.2%
Sad 8.2%
Fear 4.7%
Happy 2.9%
Confused 0.7%
Disgusted 0.5%
Angry 0.4%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a man standing in front of a store 56.4%
a man and a woman standing in front of a store 27.1%
a man that is standing in front of a store 27%

Text analysis

Amazon

10
BOX
BUTTER
BUTTER LARD MILK
LAY
MILK
BOLOGNA
SERVE
LARD
IN ICE BOX
IN
ICE
WAYS
WAYS TO SERVE
-BOY
TO
EGG'S
RED
Eggs
OR
ECONOMY
to
JE
when
S to JE
for
Scono
EM
EGG
Serre
-
S
mun
- von when
for mich
do
the
Banch
Banch set
set
Let
mich
يوم
ReaStreet
von
Economic
13
In يوم
Serry
relled
In

Google

ICE
NEM
See
EGG's
SERVE
BOLOGNA
AITTER LARD MILK IN ICE BOX M-BOY LAY NEM See E EGG's WAYS TO SERVE BOLOGNA EGE ECONDMY
LAY
TO
ECONDMY
AITTER
MILK
IN
LARD
BOX
M-BOY
E
WAYS
EGE