Human Generated Data

Title

Untitled (two scientists looking into large tank)
Date

1962
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15516

Human Generated Data

Title

Untitled (two scientists looking into large tank)

People

Artist: Jack Gould, American

Date

1962

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15516

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.1
Human 99.1
Water 98.6
Pool 98.1
Outdoors 81
Building 71.6
Monitor 67
Electronics 67
Display 67
Screen 67
Nature 64.9
Hotel 63.8
Wood 59.6
Handrail 59.1
Banister 59.1
Swimming Pool 0

Clarifai
created on 2023-10-29

light 96.7
reflection 92.2
people 92
business 90.7
car 89.7
modern 87.1
window 86.4
technology 85.8
industry 85.1
grinder 83.8
desktop 83.4
transportation system 83.3
city 82.8
man 82.6
commercial 82.3
abstraction 81.1
abstract 81
inside 77.6
indoors 77.3
street 76.8

Imagga
created on 2022-03-05

building 32.8
interior 30.1
architecture 29.8
modern 28
urban 25.3
steel 24.8
structure 23
glass 22.5
metal 22.5
device 22.1
locker 21.8
office 21.2
city 20.8
industry 20.5
technology 20
business 19.4
power 19.3
center 18.9
door 18.7
window 18.7
fastener 17.6
inside 17.5
industrial 17.2
sliding door 16.9
design 16.3
equipment 15.6
construction 15.4
light 15.4
sky 14.7
display 14
hall 14
station 13.5
science 13.3
reflection 13.3
restraint 13.2
high 13
indoor 12.8
factory 12.5
monitor 11.9
computer 11.7
futuristic 11.7
3d 11.6
gas 11.5
windows 11.5
roof 11.4
digital 11.3
case 11.3
energy 10.9
airport 10.7
bright 10.7
mall 10.7
production 10.7
environment 10.7
pollution 10.6
effects 10.4
movable barrier 10.4
corporate 10.3
three dimensional 10.3
oil 10.2
television 10.1
ceiling 9.8
plant 9.7
supply 9.6
fuel 9.6
system 9.5
house 9.2
graphics 9.1
machinery 8.8
elevator 8.8
furniture 8.8
pipe 8.7
corporation 8.7
tube 8.7
engineering 8.6
imagination 8.5
geometric 8.5
perspective 8.5
environmental 8.5
electric 8.4
screen 8.2
global 8.2
indoors 7.9
work 7.8
petrol 7.8
pump 7.8
wall 7.8
education 7.8
render 7.8
steam 7.8
complex 7.8
mirror 7.6
buildings 7.6
electricity 7.6
iron 7.5
economy 7.4
barrier 7.4
bank 7.4
new 7.3
balcony 7.2
transportation 7.2
room 7.1

Google
created on 2022-03-05

Water 96
Window 91.8
Swimming pool 90.2
Building 86.1
Rectangle 85.3
Stairs 82.6
Leisure 79.4
House 77.9
Naval architecture 75
Glass 73.4
Flooring 72.8
Recreation 72
Door 71.1
Metal 67.9
Ceiling 65.5
Symmetry 63.6
Indoor games and sports 62.8
Room 62.2
Leisure centre 62
Handrail 61.9

Microsoft
created on 2022-03-05

text 88.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 27-37
Gender Male, 100%
Sad 80.6%
Calm 8%
Angry 3.2%
Confused 2.8%
Disgusted 2.5%
Surprised 1.3%
Fear 1.1%
Happy 0.5%

AWS Rekognition

Age 45-53
Gender Male, 99.9%
Calm 98.2%
Surprised 0.5%
Sad 0.5%
Confused 0.3%
Disgusted 0.2%
Happy 0.1%
Angry 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Monitor
Swimming Pool
Person 99.1%
Monitor 67%

Categories

Imagga

interior objects 97.2%
food drinks 1.1%

Captions

Microsoft
created on 2022-03-05

a close up of a computer 37.8%
a screenshot of a computer 36%
a close up of a computer screen 34.9%

Text analysis

Amazon

KODYK
B7
B2
02
E9
B8
3
B7 B8 B9
C8
C2
E8 E9
A
C8 C9
B9
E8
C9
|
D9
D8 D9
D8
A8
A 12/13/14
D 02
g) B2 8:
F61F7
A6 A7 A8
FIF3
8:
N
f
g)
FIF3 F4|F5 F61F7 FB/F9
12/13/14
FB/F9
A6 A7
D
2
H
FIN
F4|F5
10 FIN
10

Google

A 2 A3 A4AG A7 ABA BI 82 83 B7 B8 89 c8 C9 CI C2 DI 02 D8 09 EB E9
A
2
A3
A4AG
A7
ABA
BI
82
83
B7
B8
89
c8
C9
CI
C2
DI
02
D8
09
EB
E9