Human Generated Data

Title

Untitled (woman looking at view of river from balcony of retirement home)

Date

1961

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16093.2

Human Generated Data

Title

Untitled (woman looking at view of river from balcony of retirement home)

People

Artist: Jack Gould, American

Date

1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16093.2

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.8
Human 99.8
Person 99.1
Person 98.5
Person 97.9
Patio 97.9
Porch 96.9
Person 95.5
Person 94.5
Person 94.4
Person 94.2
Handrail 93.5
Banister 93.5
Railing 86.4
Pergola 82.9
Person 76.7
Person 76.4
Person 75.7
Person 70.2
Person 58.1
Window 58
Plywood 56.5
Wood 56.5
Person 56.5

Clarifai
created on 2023-10-29

beach 99.5
people 99.5
street 99.3
girl 99.1
city 98.7
sea 98.6
travel 98.5
architecture 98.4
hotel 98.1
ocean 97.9
man 97.1
tree 96.9
summer 96.9
water 96.4
urban 96.3
light 96
wedding 95.7
woman 95.5
resort 95.3
portrait 95.3

Imagga
created on 2022-02-11

building 28.6
transportation 26
architecture 25.6
structure 25.4
city 24.1
travel 23.2
urban 22.7
transport 20.1
car 19.5
sky 19.3
bridge 18.1
modern 17.5
vacation 15.5
vehicle 15.1
water 14.7
canvas tent 14.5
road 13.5
landscape 13.4
sea 12.5
office 12.4
window 12
ship 11.8
highway 11.6
interior 11.5
traffic 11.4
deck 11.2
people 10.6
passenger 10.4
business 10.3
light 10
ocean 10
river 9.8
reflection 9.7
steel 9.7
tourist 9.7
planetarium 9.6
trip 9.4
glass 9.3
boat 9.3
speed 9.2
train 9
tower 9
technology 8.9
station 8.9
center 8.8
automobile 8.6
auto 8.6
industry 8.5
bay 8.5
journey 8.5
outdoor 8.4
balcony 8.4
summer 8.4
street 8.3
landmark 8.1
holiday 7.9
wheeled vehicle 7.9
public 7.8
passenger car 7.7
motion 7.7
support 7.6
house 7.5
tourism 7.4
town 7.4
metal 7.2
scenery 7.2
conveyance 7.2
bank 7.2

Google
created on 2022-02-11

Sky 93.9
Water 93.5
Plant 90.1
Tree 86
Building 85.7
Shade 84.3
Cloud 83.8
Travel 81.6
Tints and shades 77.3
Rectangle 76.8
Leisure 76.4
Lake 72.3
Landscape 68
Metal 65.1
T-shirt 63.8
Room 62.1
Horizon 59.5
Tourism 59.3
Vacation 58.2
Chair 56.9

Microsoft
created on 2022-02-11

outdoor 91.6
text 90.2
person 89.3
water 87.6
clothing 87
lake 85.7
sky 78.6
tree 76.8
vacation 70.7
summer 69.7
trip 68.9

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 61-71
Gender Female, 97.4%
Happy 74.3%
Calm 8.4%
Sad 6.7%
Angry 4.6%
Surprised 2.9%
Fear 1.4%
Confused 1%
Disgusted 0.8%

AWS Rekognition

Age 26-36
Gender Male, 99%
Calm 94%
Surprised 2.3%
Sad 1.3%
Happy 0.8%
Confused 0.5%
Disgusted 0.4%
Angry 0.4%
Fear 0.2%

AWS Rekognition

Age 7-17
Gender Female, 51.3%
Sad 82.3%
Disgusted 11.3%
Calm 1.6%
Happy 1.3%
Fear 1.2%
Angry 1%
Confused 0.8%
Surprised 0.5%

AWS Rekognition

Age 23-31
Gender Male, 93%
Happy 41.7%
Calm 36.2%
Confused 12.2%
Angry 4.3%
Sad 2.4%
Disgusted 1.7%
Fear 0.9%
Surprised 0.6%

AWS Rekognition

Age 35-43
Gender Male, 99.7%
Calm 73.8%
Sad 20.8%
Happy 2.5%
Angry 0.9%
Disgusted 0.7%
Confused 0.6%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 23-31
Gender Male, 98%
Calm 99.9%
Happy 0%
Sad 0%
Confused 0%
Surprised 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 83.1%
Calm 54.9%
Sad 17.8%
Happy 7.7%
Disgusted 7%
Fear 4.5%
Confused 3.9%
Surprised 2.2%
Angry 2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Person 99.8%
Person 99.1%
Person 98.5%
Person 97.9%
Person 95.5%
Person 94.5%
Person 94.4%
Person 94.2%
Person 76.7%
Person 76.4%
Person 75.7%
Person 70.2%
Person 58.1%
Person 56.5%

Categories

Text analysis

Amazon

5
Al
MAGOA
ENY Al
ENY
EITA
ROOTT
ROOTT COF E E A R EITA
COF E E A R

Google

FTVO A°2 AGOA
FTVO
A°2
AGOA