Human Generated Data

Title

Column on the ground

Date

2002

People

Artist: Joel Meyerowitz, American born 1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Yale F. Levin, MBA 2001, 2021.477

Copyright

© Joel Meyerowitz

Human Generated Data

Title

Column on the ground

People

Artist: Joel Meyerowitz, American born 1938

Date

2002

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Yale F. Levin, MBA 2001, 2021.477

Copyright

© Joel Meyerowitz

Machine Generated Data

Tags

Amazon
created on 2023-06-26

Clothing 100
Hardhat 100
Helmet 99.6
Helmet 99.4
Worker 98.4
Helmet 98.3
Person 97.4
Adult 97.4
Male 97.4
Man 97.4
Helmet 96.3
Person 96.1
Helmet 95.6
Helmet 92.8
Helmet 92.7
Urban 90.4
Helmet 90.2
Accessories 88.7
Bag 88.7
Handbag 88.7
Helmet 87.3
City 85.7
Metropolis 85.7
Helmet 85.5
People 84.9
Person 84.1
Person 83
Person 82.8
Person 82.6
Person 79.4
Person 78.5
Helmet 77.4
Helmet 76.3
Helmet 75.1
Person 73.9
Helmet 73.1
Helmet 72.6
Person 71.7
Person 71.6
Helmet 70.7
Person 67.3
Person 67.3
Person 67.1
Person 66.8
Person 66.5
Helmet 63.9
Person 63.9
Animal 63.7
Horse 63.7
Mammal 63.7
Helmet 63.6
Helmet 63.4
Helmet 62.8
Person 61.8
Transportation 60.3
Vehicle 60.3
Person 60.2
Helmet 60.2
Helmet 60.1
Road 57.5
Person 57.2
Helmet 56.3
Vest 56.2
Nature 56.1
Night 56.1
Outdoors 56.1
Terminal 55.9
Architecture 55.4
Building 55.4
Factory 55.4
Manufacturing 55.4

Clarifai
created on 2023-10-13

people 97.6
transportation system 94.8
vehicle 93.4
business 93.2
man 92
commerce 91.4
industry 89.5
road 88.6
train 86
flame 86
travel 85.8
container 85.4
watercraft 84.5
track 83.5
subway system 82.7
ship 82.1
city 81.5
railway 81.5
group together 79.6
group 79.4

Imagga
created on 2023-06-26

lights 69.5
audience 66.3
stadium 65.8
crowd 65.3
nation 63.4
patriotic 63.3
cheering 62.7
nighttime 62.6
flag 61.3
silhouette 58.8
icon 48.3
symbol 44.4
championship 43.8
event 43.4
match 43.4
skill 43.3
muscular 43
athlete 42.8
competition 42.1
training 41.6
sport 39.1
vibrant 38.5
person 38.4
people 35.7
park 35.7
player 35
field 30.9
bright 30
vivid 29.7
team 28.7
versus 28.6
design 25.9
night 22.2
teamwork 21.3
glowing 21.2
soccer 20.2
kick 19.5
pass 19.5
shoot 19.4
fight 19.3
goal 19.2
dangerous 19
playing 18.2
ball 17.5
shorts 16.6
football 16.3
shiny 15.8
stage 15.8
world 14.5
device 14.4
man 13.4
male 12.8
city 12.5
platform 12.2
light 12.1
group 12.1
uppercut 11.9
jab 11.9
supporters 11.9
global 11.8
ropes 11.8
punch 11.8
president 11.8
boxing 11.7
speech 11.7
gloves 11.6
leader 11.6
boss 11.5
block 11.5
ring 11.3
presentation 11.2
against 11
occupation 11
businesswoman 10.9
outrigger 10.7
live 10.7
concert 10.7
job 10.6
businessman 10.6
business 10.3
river 9.9
guitar 9.9
boxer 9.8
band 9.7
pop 9.7
practice 9.7
bridge 9.6
sexy 9.6
classical 9.6
cross 9.4
work 9.4
musician 9.2
music 9
stretcher 9
television 9
blues 8.9
instruments 8.8
acoustic 8.8
sword 8.8
jazz 8.8
bass 8.8
court 8.8
water 8.7
musical 8.6
performance 8.6
stabilizer 8.6
architecture 8.6
stars 8.5
travel 8.4
electric 8.4
building 8.2
stab 7.9
fencing 7.9
fans 7.9
weapon 7.9
technique 7.9
gear 7.8
blade 7.8
sky 7.7
sharp 7.6
sea 7.4
protection 7.3
litter 7.2

Google
created on 2023-06-26

Line 81.8
Rectangle 80.5
Font 79.6
Travel 79
Technology 74.5
Event 70
Motor vehicle 67.4
City 67.2
Engineering 66.7
Art 66.2
Urban design 64.6
Stock photography 63.4
Advertising 62.5
Display device 61.1
Crowd 59.6
T-shirt 55.3
Night 52.8
Transport 52.3
Brand 51.1
Road 51

Microsoft
created on 2023-06-26

text 99.8
screenshot 76.7
person 66.7
display 48.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Male, 94.4%
Sad 86%
Calm 28.6%
Confused 9.6%
Surprised 8.9%
Fear 7.5%
Angry 7.2%
Happy 4.1%
Disgusted 2.8%

AWS Rekognition

Age 43-51
Gender Female, 60.3%
Surprised 97%
Happy 11.1%
Fear 7.5%
Calm 7%
Sad 2.5%
Confused 2.2%
Disgusted 1.5%
Angry 1.3%

AWS Rekognition

Age 26-36
Gender Female, 60.6%
Calm 98.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0.9%
Disgusted 0.3%
Happy 0.1%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Female, 99.3%
Fear 95.1%
Calm 7.8%
Surprised 6.3%
Sad 2.8%
Happy 2.2%
Angry 1%
Disgusted 0.7%
Confused 0.5%

AWS Rekognition

Age 22-30
Gender Female, 96.5%
Sad 91.5%
Calm 26.6%
Fear 11.4%
Confused 8.2%
Surprised 7.6%
Angry 4.5%
Happy 2.6%
Disgusted 1.5%

AWS Rekognition

Age 24-34
Gender Male, 91.8%
Fear 84.1%
Calm 24.2%
Surprised 6.8%
Sad 3%
Angry 2%
Confused 1.7%
Happy 1.6%
Disgusted 1.1%

AWS Rekognition

Age 23-33
Gender Male, 99.5%
Calm 83.9%
Fear 8.8%
Surprised 7.3%
Sad 3%
Angry 2.5%
Confused 1.2%
Happy 0.8%
Disgusted 0.6%

AWS Rekognition

Age 20-28
Gender Female, 81.7%
Fear 88.7%
Calm 9.7%
Angry 8.9%
Surprised 6.7%
Confused 3.5%
Happy 2.8%
Sad 2.6%
Disgusted 0.9%

AWS Rekognition

Age 22-30
Gender Male, 99.4%
Calm 94.1%
Surprised 6.3%
Fear 6%
Sad 3.8%
Happy 0.5%
Angry 0.4%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 25-35
Gender Male, 95%
Calm 61.5%
Sad 42.4%
Angry 7.8%
Fear 7%
Surprised 6.7%
Confused 1.1%
Disgusted 0.8%
Happy 0.6%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 63.1%
Fear 19.3%
Surprised 7.4%
Confused 4.4%
Angry 4%
Sad 3.8%
Disgusted 1.5%
Happy 0.6%

AWS Rekognition

Age 21-29
Gender Female, 53.1%
Fear 98.1%
Surprised 6.3%
Sad 2.2%
Calm 0%
Happy 0%
Angry 0%
Disgusted 0%
Confused 0%

AWS Rekognition

Age 11-19
Gender Female, 68.3%
Calm 95.2%
Fear 6.9%
Surprised 6.3%
Sad 2.4%
Angry 0.5%
Disgusted 0.3%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 14-22
Gender Male, 91.9%
Angry 99.1%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Calm 0.4%
Confused 0.1%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 18-26
Gender Male, 93.7%
Sad 81.1%
Calm 32.2%
Confused 16.9%
Fear 7.4%
Surprised 7%
Disgusted 5.6%
Angry 1.8%
Happy 1.5%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Calm 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Confused 0%
Disgusted 0%
Angry 0%
Happy 0%

AWS Rekognition

Age 16-22
Gender Male, 99.9%
Sad 74.9%
Calm 56.1%
Surprised 6.6%
Fear 6.3%
Angry 4.8%
Disgusted 1.4%
Confused 1%
Happy 0.4%

AWS Rekognition

Age 24-34
Gender Male, 97.5%
Calm 90.2%
Surprised 6.6%
Fear 6%
Sad 4.2%
Angry 3%
Disgusted 0.4%
Confused 0.3%
Happy 0.2%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 97.2%
Surprised 6.3%
Fear 6%
Sad 2.7%
Angry 0.2%
Confused 0.2%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 18-26
Gender Male, 99.9%
Calm 71.1%
Confused 9.5%
Surprised 7.8%
Fear 7.3%
Sad 4.9%
Angry 3.5%
Disgusted 2%
Happy 1.6%

AWS Rekognition

Age 14-22
Gender Male, 95.9%
Calm 43.5%
Fear 32.9%
Surprised 8.9%
Angry 6.9%
Sad 5.6%
Disgusted 3.9%
Happy 2%
Confused 1.6%

AWS Rekognition

Age 18-26
Gender Male, 64%
Fear 89.9%
Calm 10%
Surprised 7.6%
Angry 7.4%
Sad 3.6%
Happy 1.1%
Confused 0.7%
Disgusted 0.6%

AWS Rekognition

Age 19-27
Gender Male, 97.6%
Calm 92.6%
Surprised 6.4%
Fear 6.3%
Sad 3%
Angry 2.3%
Confused 0.8%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 4-12
Gender Female, 93.4%
Calm 79.7%
Sad 10.6%
Fear 7.8%
Surprised 6.4%
Angry 1.8%
Disgusted 0.7%
Confused 0.6%
Happy 0.4%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 96.5%
Surprised 6.4%
Fear 5.9%
Sad 2.6%
Angry 0.6%
Confused 0.6%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 98%
Fear 95.3%
Calm 8%
Surprised 6.6%
Sad 2.7%
Happy 1.4%
Angry 1.3%
Disgusted 0.6%
Confused 0.4%

AWS Rekognition

Age 16-24
Gender Male, 99.9%
Calm 93%
Surprised 6.5%
Fear 6.1%
Sad 2.9%
Confused 2.3%
Angry 1%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 26-36
Gender Male, 54.7%
Sad 99.5%
Angry 16.1%
Fear 9.4%
Surprised 6.9%
Happy 4.9%
Disgusted 3.1%
Calm 2%
Confused 1.8%

AWS Rekognition

Age 23-31
Gender Male, 81.6%
Calm 57.7%
Angry 24.2%
Fear 7.5%
Surprised 7%
Sad 4.6%
Disgusted 2.9%
Confused 2.8%
Happy 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Helmet 99.6%
Person 97.4%
Adult 97.4%
Male 97.4%
Man 97.4%
Handbag 88.7%
Horse 63.7%

Categories

Imagga

cars vehicles 99.3%

Captions

Microsoft
created on 2023-06-26

graphical user interface, website 99.9%

Text analysis

Amazon

475.WTC
475.WTC 2002-05.28.11-38
2002-05.28.11-38
CONTR
9235
agress 9235
26
agress

Google

POSS $235 475.WTC 2002-05.28.11-38 123 CONTR
POSS
$
2002-05.28.11-38
CONTR
235
475.WTC
123